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ABSTRACT 

The H 2 , fixed architecture, control problem is a classic LQG problem whose 
solution is constrained to be a linear time invariant compensator with a 
decentralized processing structure. The compensator can be made of p 
independent subcontrollers, each of which has a fixed order and connects selected 
sensors to selected actuators. The H 2 , fixed architecture, control problem allows 
the design of simplified feedback systems needed to control large scale systems. 
Its solution becomes more complicated, however, as more constraints are 
introduced. This work derives the necessary conditions for optimality for the 
problem and studies their properties. It is found that the filter and control 
problems couple when the architecture constraints are introduced, and that the 
different subcontrollers must be coordinated in order to achieve global system 
performance. The problem requires the simultaneous solution of highly coupled 
matrix equations. The use of homotopy is investigated as a numerical tool, and 
its convergence properties studied. It is found that the general constrained 
problem may have multiple stabilizing solutions, and that these solutions may be 
local minima or saddle points for the quadratic cost. The nature of the solution 
is not invariant when the parameters of the system are changed. Bifurcations 
occur, and a solution may continuously transform into a nonstabilizing 
compensator. Using a modified homotopy procedure, fixed architecture 
compensators are derived for models of large flexible structures to help 
understand the properties of the constrained solutions and compare them to the 
corresponding unconstrained ones. 
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INTRODUCTION 


1.1 ON THE CONTROL OF LARGE SCALE SYSTEMS 


1.1.1 General 

Some physical systems necessitate the use of large dimensional state vectors to 
describe their complex dynamics. Economic and ecologic models, power and 
communication networks, are examples of such systems and have motivated the 
early developments in the study of large scale systems. Another example of such 
systems are structures, which 'must theoretically be modeled with infinite 
dimensional state vectors. Structural modes in a system can be usually ignored if 
they are at sufficiently high frequencies and are well damped. This is not the 
case for large, flexible, space structures, where a large number of structural 
modes have to be actively controlled to reduce vibration levels. The controller 
cannot, on the other hand, become too complex because of implementability, 
reliability and robustness considerations. The required level of complexity in 
wiring, centralized data collecting, and centralized processing may not be 
achieved with the existing flight qualified hardware. It may result in an 
unacceptable loss of performance due to time delays and the necessity to 
dramatically reduce the sampling frequency. The complexity of the system 
makes it prone to more failures. Since vibration suppression on flexible space 
structures is the principal motivation of this work, Linear Time Invariant (LTI; 
systems are considered. 

The complexity of the large scale problems influences their study, the 
control design procedures and the implementation of the control law. The size uf 
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the model must be chosen in accordance with the numerical tools at hand, 
limiting right away the level of details that one can reach. The accuracy of the 
model deteriorates, in any case, as it tries to encompass too many effects, and a 
larger model may be highly unreliable. The control synthesis techniques that 
require a complete model are also limited in the size of problems they can reliably 
handle. Finally, the controller must remain simple enough in order to be 
implementable. The goal of all the methods developed to handle large scale 
problems is to simplify the model, the design method, or the structure of the 
compensator [San78]. The trade-off in all design methods is made between 
system performance, control feedback complexity, and design procedure 
complexity. Better performance usually requires more complex control schemes. 
An optimal controller may be, however, more difficult to obtain, and suboptimal 
designs may be preferred since they can be usually found in a simpler way. 

Large scale systems can usually be seen as a large number of simpler 
interconnected subsystems. This is a result of the modeling process in many 
cases, since one can reliably identify the local dynamics and the local interactions 
only. Large systems are, thus, generally built from the bottom up. Finite 
element methods, for example, model large structures by breaking them down 
into smaller rigid elements, and they also require a model of the local interaction 
properties. The resulting assembled model has dynamics that approximate 
realistically the original structure. Power and communication networks are also 
usually modeled as the interconnection of nodes which are characterized by their 
own fast internal dynamics and the way they interact with neighboring nodes. 
The nature of the connections and of the coupling are paramount properties that 
shape the behavior of the overall system [Kok81, Chw82]. The next section 
shows how they may influence the choice of a control architecture. 


1.1.2 Decentralized versus Hierarchic Control Architectures 

[Kok81, Chw82] distinguish two types of large scale systems in power networks 
The characterization can be extended to other large interconnected systems 
Each type suggests a specific control architecture that provides simpler feedback 
systems with high performance [San78]. 
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The first class of systems is constituted by weakly coupled systems. When 
the coupling between subsystems is weak, the internal dynamics of one subsystem 
are only slightly modified when the other subsystems are connected. Hence, the 
global dynamics of the interconnected system can be approximated by studying 
the internal dynamics of each isolated subsystem. 

The architecture of such systems suggests the use of a decentralized 
control structure. Each subsystem is provided with its own independent 
controller that uses only local information and has only local control authority. 
The control structure is much simpler since one does not need to take into 
account the overall complexity of the system. The coupling should not change 
the performance of the closed loop system more than it affects the open loop 
system. For weakly coupled systems, a locally decentralized control architecture 
appears therefore to be the natural way to simplify the compensator. 

The second class of systems recognized in [Kok81, Chw82] is made of 
weakly connected systems. The dynamic matrix of an interconnected LTI system 
is assembled using the subsystem dynamic matrices and the interaction matrices. 
The diagonal blockmatrices represent the internal dynamics of each subsystem, 
and the off-diagonal blocks represent the interconnection. A weakly connected 
system is such that the size of the off-diagonal elements are comparable to the 
smallest terms of the internal dynamic matrices. The overall dynamics will have 
two timescales. Steady disturbances and steady commands will be propagated 
throughout the entire system and the connections will make the subsystems act 
in a coherent manner, more like a group. Rapidly varying disturbances and 
commands introduced locally, on the other hand, will be filtered by the weak 
connections and will result in a fast, mostly local, incoherent response of the 
subsystems. Coherence and incoherence should be understood, here, as the 
possibility or the impossibility to determine and to control the actions of remote 
subsystems using local information and local control with a bandwidth 
comparable to that of the actions in question. 

A natural control architecture appears to be, in the case of weakly 
connected systems, a multilevel, or hierarchic, control structure. Fast local 
controllers can handle the fast, incoherent dynamics of the system, while an 
upper level controller handles the slow coherent motion. At the lower le\ei 
controllers gather information locally and receive directives from the upper level 
The information is also condensed and sent to the upper level. The upper level 
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receives the aggregate information from the lower level and estimates the 
interaction between the subsystems. In return, it calculates directives to send to 
the lower levels. This ensures some degree of cooperation between the 
subcontrollers and increases the overall performance of the system. 

Weak coupling and weak connections are hard to identify in most cases. 
Such properties are asymptotic and, if in the limit the design procedure yielding a 
decentralized or a hierarchic control is simplified, this will not be the case in 
general. One must therefore find a general design method that can generate 
simplified control structures in a systematic way. Optimality based methods 
and, especially, Linear Quadratic (LQ) methodologies, have been very successful 
at generating complex multiloop controllers in an integrated fashion. The 
computation of the controller is automated and the mathematical details of the 
procedure are hidden from the designer. The design is therefore performed at the 
system level and deals with control issues only. 


1.1.3 On Linear Quadratic Control Design Methodologies 

Optimal LQ control for linear systems was not originally stated as a feedback 
control problem. The LQ control problem consists of driving the states of a 
system from an arbitrary initial condition X 0 back to zero in a prescribed amount 
of time tf, while minimizing the integral over time of a quadratic cost functional 
involving the states of the system and the inputs required for control. Such a 
cost index is an energy measure for the closed loop system and is therefore an H 2 
norm. The resolution of the finite time problem is a differential two point 
boundary value problem that can be solved even if the system is linear, but time 
varying. The control law is an open loop scheme since the solution to the 
problem is the time history of the control to be applied. As tf goes to infinity, 
and if the system is time invariant, the solution becomes, however, a static 
feedback law and is known as the Linear Quadratic Regulator (LQR), [Kwa72bj 
The feedback solution has many desirable properties: the first one is that the 
closed loop system is guaranteed to be stable under stabilizability and 
detectability assumptions [Kwa72b]. The control yields a guaranteed phase 
margin of 60 degrees and has a gain margin extending from one half to infinity 
The properties of the LQR in terms of classical feedback theory are therefore 
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excellent, even though the method was not derived for such a purpose. The 
calculation of the gains requires solving a matrix Riccati equation for which very 
accurate and reliable software has been developed. Hence, the computation of 
the solution is generally not an issue. 

The LQR solution is rather impractical since it requires the knowledge of 
all the states of the system. Extending the Kalman-Bucy filter ideas to control, 
the LQG methodology generalizes the LQR to the case where only a limited 
number of measurements are available. The problem is set in a stochastic 
framework. White noise enters the plant and corrupts the measurement. The 
cost to be minimized is quadratic, even though it has to be averaged to comph 
with the probabilistic approach. The main property of the problem is that it 
separates into an LQR problem and an optimal filtering problem, this is known 
as the separation principle [Kwa72b]. The filter and the control problem can be 
solved independently without influencing one another. The closed loop system is, 
again, guaranteed to be stable under detectability and stabilizability 
assumptions. The optimal control and filter gains are found by solving two 
independent Riccati equations. The procedure is, therefore, still very easy from a 
numerical viewpoint. The compensator has become an LTI dynamic compensator 
of finite order. Its dynamics require as many poles as the plant. The LQG 
methodology produces truly multiloop dynamic output feedback compensators 
and constitute a very interesting design procedure. The price paid by 
implementing a filter is that there is no more guarantee of gain and phase 
margins [Doy79]. 

The LQG solution possesses many asymptotic properties which can be 
used to obtain feedback performance stated in terms of classical control theory 
criteria. The LQG/LTR (Loop Transfer Recovery) methodology is based on 
these asymptotic properties [ Ath86] . The design goals are stated in terms Ol 
sensitivity, disturbance rejection, command following and crossover frequency 
The LQG is only a tool and has lost its optimality significance. The cost and the 
perturbations have become generic parameters that are used to obtain frequency 
domain properties. Classical control design techniques, such as the use of 
integrators to fight steady state disturbance and obtain zero tracking error, can 
be incorporated. Frequency shaping of the noise and the cost allows one . j 
design, for example, notch filters, and to tailor the sensitivity properties in 
chosen frequency ranges [Gup80]. 
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In summary, LQ methodologies provide a very flexible design tool that 
produces multiloop designs as easily as single loop designs in an integrated 
fashion. They guarantee closed loop stability, and frequency domain properties 
can be obtained by a proper selection of the quadratic cost and of the disturbance 
characteristics. Very fast and very reliable software has been developed to solve 
the problem numerically. The design can be easily iterated by changing the 
parameter of the optimization problem. Even though the optimization procedure 
looks at enhancing the nominal performance of the plant, a compensator with 
satisfactory robustness characteristics can be found in most cases. The current 
LQ designs may not, however, be applicable to the control of large scale systems 
since their use would produce centralized compensators of very large order. 


1.1.4 Defining General Architecture Constraints 

A generic way for constraining the control architecture must be defined in order 
to modify the LQ optimization problem. Locally decentralized control schemes 
for weakly coupled systems as well as multilevel schemes for weakly connected 
systems should obey these general architecture constraints. The choice made in 
this present work is to allow for a decentralized processing structure. The 
following will define in more details what a decentralized processing structure is. 
and we will try to motivate such a choice. 

The decentralized processing structure consists of dividing and 
distributing the processing of the data and the control law to several smaller 
processors, or subcontrollers. The different processors are not allowed to 
communicate. Their control authority and the information they receive may also 
be limited. Each subcontroller may be connected to a smaller number of selected 
sensors and, similarly, it may be connected to a smaller number of selected 
actuators. The complexity of each subcontroller can be reduced and the order of 
the transfer function realized by a given processor may be fixed by the designer. 
Many control architectures follow these general constraints. In particular, the 
full order centralized compensator consists only of one full order subcontroller: 
the reduced order centralized compensator consists of one subcontroller with a 
number of poles; locally decentralized compensators defined in Section 1.1.2 are 
made of many subcontrollers which use local sensors and local actuators. 
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Decentralized processing does not mean, however, that all the fixed 
architecture compensators in that class will have the characteristics of being 
locallv decentralized. Compensators with hierarchic characters can be generated 
as well. Consider, for example, a flexible beam with many sensors and many 
actuators. Assume that some subcontrollers are required to use the signals 
coming from closely located sensors and are connected to actuators located in the 
same region. These local subcontrollers will have high control authority on the 
local dyn ami cs, but poor control authority on the global dynamics of the beam 
since they require the beam to propagate information to and from remotely 
located points of the structure. On the other hand, aggregate information can be 
obtained by merging local sensor information at different location on the beam 
and sending it to one subcontroller. This subcontroller can also have high control 
authority on the global modes of the structure if it has access to actuators spread 
throughout the entire beam. Again, local actuators can be aggregated so that the 
subcontroller can only have a limited control resolution at the local level. Such a 
control structure can result in the "local" subcontrollers having a higher 
bandwidth than the "global" subcontroller. The actual implementation of such a 
scheme may have a multilevel aspect: local computers will have a direct 
authority on the local sensors and the local actuators. They gather and merge 
the information to send to the global controller and, in return, obtain the 
aggregate inputs that can be added to the local control inputs. 

The decentralized processing structure appears, therefore, to be a very 
general structure that can generate many different control architectures that wdh 
be simpler, and yet have high performances. The H2, fixed architecture control 
problem consists of defining an LQ problem and looking for the optimal solution 
that belongs to the set of compensators having a required control structure. The 
centralized full order compensator as well as the centralized reduced order 
compensator can be viewed as special cases of decentralized processing. Hence, 
the constrained architecture that is chosen generalizes the compensator structures 
that has been already used. The H2 fixed architecture control design problem is 
therefore a generalization of existing LQ design methodologies. This method 
should produce controllers of adequate complexity while retaining some of the 
properties of the more classic LQ designs. 
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1.2 RESEARCH OBJECTIVES AND CONTRIBUTION 


As it has already been stated, the purpose of this work is to generalize the LQ 
design methodology in order to produce H 2 optimal fixed architecture 
compensators which will satisfy the implementability requirements for large scale 
systems. Constrained techniques have already appeared in the development of 
the LQ methodologies [Lev70, Joh70j. They have been principally focused on 
reducing the order of the compensator. Reduced order, frequency domain 
oriented, designs have been recently considered [Cal89]. More general 
architectures have been considered as well [Wen80, Ber87b]. Most of the work 
done on constrained LQ techniques has consisted of deriving the optimality 
conditions and using some general purpose algorithm to solve the problem. Very 
few general properties of the method have been found until [Hyl84] which 
uncovered some of the structure of the reduced order problem. Simultaneously, 
homotopy, or continuation, algorithms have been proposed to solve the reduced 
order problem [Ric87, Ric89]. The claim is that such procedures are very good at 
solving complex, coupled matrix equations. Convergence appears to be better 
than existing procedures, but little has been proved theoretically. 

The contribution of this work is to extend the understanding of the 
reduced order problem to the fixed architecture case. A structured set of 
optimality conditions is derived. It clearly shows the effect of the order and 
architecture constraints on the solution: the separation principle does not hold 
anymore; the control and filter Riccati equations that appear in the 
unconstrained LQG problem are modified and become coupled; some of the 
coupling comes from the reduction of the order, as shown in [Hyl84]. This work 
also shows that the multiple subcontrollers need to be coordinated since the 
overall control system must optimize a global cost index. One must, therefore, 
solve simultaneously the filter and control problem, find the optimal coupling 
and the optimal coordination between subcontrollers. 

The second contribution of this work is to develop a homotopy algorithm 
for solving the fixed architecture problem, to investigate its convergence 
properties, and to refine the procedure to make it more reliable and deal with 
singularities. A general understanding of the nature and the number of solution? 
to constrained LQG problems is gained in the process, and it is shown, in 
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particular, that the homotopy algorithms do not have global convergence 
properties and must therefore allow for noncontinuous behavior of the solution at 
some critical points. The study shows that the optimality conditions have many 
solutions, some being stabilizing, some being nonstabilizing, and some being local 
maxima, minima or saddle points. The number of minima, saddle points and 
stabilizing solutions is problem dependent and is not constant when the problem 
parameters are changed. The problem loses the central property of having a 
unique stabilizing solution as soon as constraints are introduced. 

Finally, a third contribution is the derivation of some realistic design 
examples. The examples help test the numerical procedure. They also uncover 
some of the properties of the constrained designs and relate them to the 
properties of corresponding unconstrained designs. Finally, the examples provide 
a partial understanding on how to select the control architecture. 


1.3 THESIS OUTLINE 


This document is organized in seven chapters, including the present introduction. 
Chapter 2 is devoted to reviewing different approaches that have been proposed 
for controlling large scale systems. Many approaches try to utilize the special 
properties of the system they try to control and result in simplified design 
procedures. Other approaches try to simplify complex controllers obtained 
through unconstrained optimization. A constrained optimization procedure will 
be more complicated, but it will produce better designs. The review helps put 
the present work into perspective. 

The optimality conditions for the H 2 fixed architecture control problem 
are derived in Chapter 3. The analytic form of the Hessian is also derived. The 
Hessian is the matrix of second derivatives, and it plays a central role in the 
derivation of a continuous homotopy algorithm. It also allows the determination 
of the type of solutions that are obtained, minimum, maximum or saddle point, 
and it characterizes critical points whose role is preeminent in homotopy based 
techniques. 
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Chapter 4 is devoted to the study of the properties of the optimality 
conditions. Structured conditions are developed to show how the LQG problem 
is modified when order and architecture constraints are introduced. The chapter 
also shows that the problem is under-determined: the optimal solution defines 
the compensator transfer function and the cost functional is invariant when the 
state space realization of the controller is changed. Minimal and reduced sets of 
parameters and equations are studied in the chapter. 

A continuous homotopy algorithm is developed in Chapter 5 and its 
convergence properties studied. The numerical problems that follow from the 
under-determination of the state space realization of the controller are resolved. 
The number and the nature of the solutions to the fixed architecture control 
problem are investigated, and the reliability of the algorithm is improved by 
allowing jumps in the solutions when critical points are encountered. 

Chapter 6 contains a variety of design examples aimed at testing the 
numerical procedure and understanding some of the properties of the constrained 
compensators. Two large flexible structures are more particularly investigated. 

Chapter 7 ends this document with some conclusions and 
recommendations for future work. Five appendices can be found at the end of 
the document. They contain technical proofs that have been omitted in the text 
and details of the numerical problems that are treated in the various chapters, as 
well as details of the solutions obtained numerically. 
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OVERVIEW OF DESIGN APPROACHES 
TO THE CONTROL OF LARGE SCALE SYSTEMS 


2.1 OVERVIEW 


The field of large scale systems has generated many different control approaches 
[San78]. The complexity of large scale systems requires that simplifications be 
made in many cases. These simplifications concern either the modeling of the 
system, the structure and complexity of the controller, or the design procedure 
itself. Different methods try to use different properties of the systems to generate 
simpler control laws. The simplifications they perform have adverse effects on 
the performance of the control system. 

Model simplification and design simplification procedures are shown to 
work well when the system has specific properties, such as being weakly coupled 
or weakly connected [Kok81, Chw82], These properties ensure that the simplified 
designs produced by these methods are near optimal solutions. 

When no such asymptotic properties exist, one must use direct 
constrained optimization techniques. The constraints that are applied to the 
problem ensure that the controller that is generated meets some implementability 
requirements. The multiplication of the architecture constraints make the 
problem harder to solve, but it yields controllers which perform better. 

Higher control layers have been considered to recover some of the 
performance lost with simpler design techniques. Multilevel, or hierarchic, 
control methods separate the control int many levels. Higher levels try t 
coordinate the local controllers to increase the global performance of the system 
The structure of the controller gains in complexity, but the overall design 
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procedure is simpler. Again, asymptotic properties are required. The following 
sections discuss in detail these various control design approaches found in the 
literature. 


2.2 SIMPLIFICATION METHODS 
2.2.1 Aggregation Method 

Model simplification methods were first to appear and were aimed at making the 
study of large systems possible. Aggregation techniques, [Aok68, Chi71, Sir79], 
appeared in the field of economy. Economic systems consist of a large number of 
agents which act independently and have essentially similar dynamics. Those 
agents can be individuals in the economy and the dynamics describe the way they 
spend, invest, or save their income. As long as the dynamics are similar and 
there is no interaction between the agents, only one average individual is 
necessary to describe the behavior of the whole, and the different agents can be 
aggregated into one single state, thus reducing tremendously the analysis of 
economic equilibria. Some theoretical justifications have been brought to the 
original idea. The principle of aggregation has been shown to be a particular 
form of contraction [Ike80b]. Its goal is, in fact, to find a reduced order dynamic 
system which matches at all time, and for any initial conditions, the projection of 
the overall state vector. That is, the trajectory of the aggregate system, for 
initial conditions being the projection of the entire initial state vector, will be the 
projection of the trajectory of the complete system, when both are driven by the 
same inputs. The choice of the projection is the objective of the aggregation 
procedure. In the case of redundant states and redundant equations, as it is the 
case when independent agents are acting in a similar fashion, the averaging over 
the agents is the same as starting with the initial average and propagating it 
using the common dynamics of the different agents. It was shown in [Sir79] that 
in order to have an exact match between the projected trajectory and that of the 
simplified model, one has to select modes of the original system and project their 
eigenstructure onto the reduced subspace. The choice of a good aggregate model 
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consists, therefore, of selecting the predominant modes of the original system. 
The choice in [Sir79] is based on the size of the modal residuals of the plant 
transfer function. 

Control strategies have been tried using aggregated models for general 
linear time invariant systems [Sir79]. Considering the Linear Quadratic 
Regulator (LQR) for control purposes, suboptimal control laws can be derived 
using the simplified model. The idea is to solve the LQR problem for the reduced 
order system using an aggregated cost functional which is as close as possible to 
the cost functional chosen for the complete system. The implementation of the 
reduced order control law to the complete system will yield a stable system 
whose poles are the modes not retained in the aggregation and the closed loop 
poles of the reduced order system. The modes not retained in the aggregate 
model do not change since the corresponding states are not contained in the 
aggregate state vector which is fed back. A lower bound for the optimal cost that 
one would obtain by designing the optimal regulator problem for the overall 
system can be evaluated, yielding a measure of suboptimality [Sin78, Ike84j. 
LQR is a full state feedback scheme which is very unrealistic for large systems. 
Direct output feedback, and modified Linear Quadratic Gaussian (LQGj 
techniques using a simplified observer are also investigated in [Sir79]. Spillover 
results from feeding back the states which are not modeled but which are present 
in the measurement and corrupt the filter. Stability cannot always be 
guaranteed and the near optimality of the design cannot be estimated in that 
case. Global stability of the complete system can be guaranteed sometimes. The 
coupling via the measurements and the feedback law between the modes retained 
in the simplified model, and those which were not, must remain in that case 
within some bounds which depend on the closed loop dynamics of the aggregate 
system. 
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2.2.2 Other Forms of Model Reduction 


[Hyl85] contains a thorough review and an enlightening discussion on order 
reduction techniques. The paper recognizes two kinds of approaches, some which 
are optimality based approaches and others which rely on system theoretic 
arguments. Optimality based methods involve the minimization of the norm in 
operator space of the difference between the complete and the approximate 
model. The norm considered in [Wil70] is the weighted covariance of the steady 
state output error between the outputs of the original and the reduced order 
system, with both systems being driven by the same white noise. The norm is 
therefore an H 2 norm. Necessary conditions for optimality can be obtained and 
solved as a parameter optimization problem. The contribution of [Hyl85], which 
looks at the same problem, is to uncover the structure of the solution. It shows 
that one must find two positive semidefinite matrices, called pseudogrammians, 
that satisfy modified versions of the Lyapunov equations that yield the 
controllability and the observability grammian for the original system [Hyl85]. 
The pseudogrammians are rank deficient, reflecting the fact that the order of the 
approximate model is smaller than that of the original system. The nullspaces of 
the pseudogrammians are governed by a projection operator which has to obey 
optimality conditions as well. The projection selects the part of the state space 
that is retained in the reduced order model. It takes into account simultaneously 
the three geometries of the problem, the eigenstructure of the system, the 
geometry induced by the control matrix and the geometry induced by the 
measurement matrix. Such an approach is very different from selecting modes. 

Other norms have been used in order to evaluate the performance of the 
simplified model. [Glo84] uses the Hankel norm [Fra87] of the error between the 
outputs of the complete system and of those of the reduced order model, as both 
systems are subjected to the same inputs. The choice of the Hankel norm makes 
the model reduction problem tractable and solvable, and it also minimizes an 
upper bound on the infinity norm of the error between the impulse responses of 
the two models. The direct minimization of the infinity norm of the difference 
between the impulse responses makes the solution of the problem much more 
difficult to find since it is a constrained model matching problem for which no 
simple resolution method exists as yet. The optimal reduced order model is 
shown in [Glo84] to match the highest Hankel singular values of the original 
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system. The infinity norm of the difference between the frequency responses is 
bounded from above by the sum of the smallest Hankel of the system which have 

not been matched. 

The method of Skelton [Ske80] is guided by optimality consideration as 
well. The method does not however solve any optimization problem, but it 
selects states based on their contribution to a quadratic cost. This method 
sacrifices optimality for simplicity in the solution procedure. Nevertheless, the 
idea of cost component ranking remains very important and has some interesting 
applications. Cost component ranking is indeed used in [Hyl85] in order to sort 
the various solutions to the optimal problem. When incorporated to the 
numerical software, it helps the solution converge toward the global minimum 

[Hyl85]. 

A second type of approach is based on system theoretic arguments 
[Mor81]. The goal of the method is to eliminate subsystems which contribute 
little to the impulse response of the system. The method considers the difference 
between the weighted impulse response of the complete and the approximate 
systems. The error is therefore totally similar to that of the quadratic based 
optimality method of [Wil70]. Instead of performing the optimization, however, 
the method of [Mor8l] considers a state space representation of the original 
system such that the controllability grammian is equal to the observability 
grammian and both are in diagonal form. Such a state space realization is called 
a balanced realization. The representation gives symmetric roles to the control 
matrix and to the output matrix of the system. The states that correspond to 
the largest eigenvalues of the balanced grammians are then selected to form the 
reduced order system. When the original system is composed of weakly coupled 
systems, the method produces a near extremal solution for the quadratic cost. 
There is no guarantee however that this near extremal point is the global 
minimum, or even just a local one. The method can indeed be compared to ti.e 
cost component ranking approach since it tends to break up the cost into the sum 
of many contributions. The choice of the states in the balancing techniques does 
not take into account however the value of the contribution to the cost but a 
quantity which is similarity invariant and which, therefore, ignores scaling which 

is a central part of any cost functional. 

Model reduction techniques work well when the system can be represented 
as two weakly coupled subsystems, like weakly connected systems, and when its 
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dynamics separate into one slow and one fast part which remain lightly coupled. 
Any type of control design can be attempted on the reduced order model. One 
must, of course, keep in mind the existence of the extra dynamics and the 
problem of spillover that might drive the unmodeled part of the system unstable. 
Techniques similar to that of [Sir79] can be used in order to guarantee some level 
of stability. The model reduction techniques that try to minimize the coupling 
yield potentially larger margins of stability, allowing for better control 
performance. The performance of designs obtained with a simplified system 
remains, however, intrinsically limited since there is no mechanism to reduce the 
potentially negative effects of the part of the dynamics that have been ignored in 
the design. The procedure will be successful only if the ignored dynamics have an 
asymptotically small effect on the dynamics of the system in the control 
bandwidth or, conversely, if the control bandwidth is kept low. Model reduction 
may therefore be considered for analyzing the systems but may be a poor 
approach to designing simplified controllers. 


2.3 PERTURBATION TECHNIQUES 


2.3.1 Forewords 

Perturbation techniques are based upon asymptotic properties of the systems to 
which they apply [San78]. A distinction is made between singular and 
nonsingular perturbations, for both types lead to very different developments. 
Nonsingular perturbation theory applies to composite systems constituted of 
weakly coupled subsystems. As the coupling vanishes, the system becomes a set 
of independent subsystems. As long as it remains within certain bounds, the 
coupling can be ignored and the control can be designed for each individual parts 
Singular perturbation theory applies to systems with slow and fast timescales. 
As the fast dynamics become infinitely fast, the corresponding fast states can be 
condensed out and the resulting system is made of a slow global dynamics. If the 
slow time scale is infinitely slow, the fast modes can be controlled about the 
quasi-steady state set by the slow dynamics. Such an approach leads naturally to 
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hierarchic control structures. 


2.3.2 Nonsingular Perturbations 

The nonsingular perturbations occur in the case of weak coupling [San78, KokSl, 
Chw82]. The overall system is composed of interconnected dynamic subsystems. 
Each subsystem has a proper set of sensors and actuators and a proper dynamics. 
The coupling is such that the dynamics of each individual subsystem is only 
slightly perturbed when the other systems are connected. In that case, one 
intuitive approach is to neglect the interaction and consider each subsystem as 
isolated. Local controllers can then be designed and the closed loop 
characteristics of each subsystem should be only slightly changed when the other 
subsystems are connected as long as the coupling remains asymptotically small. 

The determination of the magnitude of the coupling is, of course, a 
difficult task, and one main area of research has been to determine bounds below 
which the composite system is guaranteed to be stable. A set of interconnected 
svstems that remains stable as a whole for any value of the coupling, as long as 
the coupling stays within a predetermined class, is called connectively stable 
[Sil73, Sil76, Sil78, Sin78]. The property is intimately tied to the choice of 
coupling that is allowed. One would like to find control systems that maximize 
the class of coupling for which the system remains stable in order to gi\e trie 
system more robustness. To that effect, [Sil73] proposes the following design 
procedure: first, solve for each isolated subsystem the LQR problem with 
guaranteed degree of stability. The quadratic cost functional is the integral o\er 
time of the quantity e^ a ^(X^QX + U^RU), where X is the state vector, U the 
input vector, Q and R are weighting matrices. This guarantees the closed loop 
poles of the isolated subsystems to have a real part below -a. Second, adjust the 
parameter a so that the system is connectively stable. The property translates 
into an algebraic criterion involving the internal dynamics of the subsystems and 
the coupling [Sin78]. Roughly speaking, the system will be connectively stable if 
the local dynamics is much faster than those of the outer loops, \\hc:e 
bandwidths are tied to the strength of the connections. The increase in a makes 
the local dynamics faster and allows for larger stability margins. Such margin; 
are computed in [Sil73, Sil76, Sil78]. The computation of the bound as well as the 
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derivation of the connective stability criterion in [Sin78] involve the use of vector 
Lyapunov techniques, [Sil78j. Such techniques consist of building suitable 
Lyapunov functions for each independent subsystem. The resulting global 
Lyapunov function is the sum of the local Lyapunov functions and, whereas it is 
difficult to prove that the time derivative of the overall function is negative when 
the size of the coupling is not exactly known, an upper bound for that derivative 
can be found using the local functions. This bound will be guaranteed to be 
negative as long as some simpler inequality conditions are met by the local 
Lyapunov functions and which involve the local dynamics as well as some simple 
upper bound on the coupling. Vector Lyapunov methods provide, therefore, a 
simpler sufficiency test for connective stability. [Ike80a] generalizes the study of 
connective stability to time varying systems. 

The design obtained by ignoring the coupling results in a decentralized 
control scheme where each subsystem is controlled by its local actuators using 
local state variables. It yields very good robustness characteristics, since the 
system remains stable for a large class of structural changes. This approach can 
be qualified as noncooperative since the system is broken down into subsystems 
which are made as independent as possible. Hence, the dynamics of the system, 
and especially the coupling existing between the subsystems, is not fully used by 
the local controllers which only have a limited knowledge of the overall structure. 
The subsystems do not cooperate and neither do the controllers. This implies 
relying on higher control gains, and it does not consider the fact that the coupling 
may actually be beneficial. The two beam example of [Ber87b] shown in Chapter 
5 illustrates this phenomenon: the coupling is introduced between two beams via 
a increasingly stiffer spring. Each beam has its own controller, and the feedback 
implemented is the optimal decentralized controller. As the spring stiffness is 
increased, but remains small, the optimal cost decreases. The coupling can. 
therefore, have a beneficial effect (Chapter 5, Table 5.5). 

A hierarchic control scheme can also be derived using the connective 
stability philosophy [Sin78, Sin80] . Indeed, one can try to actively reduce the 
size of the coupling between subsystems. Such a task must be performed at an 
upper level since the interaction results in a global effect. The approach of 
[Sin78, Sin80] is to design local LQ regulator loops for each isolated subsystem 
The perturbation entering each subsystem in the form of coupling is reduced by a 
global controller which tries to reduce the interaction as much as possible. In the 
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best case, the design decouples the subsystems via the global controller, and then 
implements local optimal regulators for each subsystem. Such a controller is of 
course suboptimal. Bounds on suboptimality are computed in [Sin78]. The 
optimal performance being considered there is however the one obtained with 
zero coupling. The approach presents some advantages in the simplicity of the 
design: finding the gains that decouple the subsystems is nothing more than an 
algebraic manipulation; the remaining task is to solve a number of reduced order 
Riccati equations for the subsystems considered as isolated, with order much 
smaller than that of the complete system. The robustness is improved and one 
does not even require the connection to be linear to ensure the connective 
stability. Its drawbacks are the same as with the decentralized structure. The 
noncooperation goes even further since some control effort is spent to fight the 

coupling. 

The cooperation between local controllers can be improved by including 
some part of the coupling in the design, [Sil79, Hod86]. The idea is to make the 
subsystems overlap: the system state variables are partitioned into subsets which 
define the state vectors for the subsystems; an overlapping partition will allow for 
one state variable to be shared by the state vectors of two or more subsystems. 
The dynamics of such a variable will therefore be taken into account by manv 
different local controllers. Based on the results of [Ike84] on system expansion 
and system contraction, it is shown in [Hod86] that the problem considered is 
similar to that of [Sil73] and the design procedure is in fact the same: for each 
isolated subsystem, the LQR problem with guaranteed degree of stability is 
solved. The bound for a is less conservative when an overlapping decomposition 
is used [Oth86]. [Ike80b] shows that more freedom exists to build vector 
Lyapunov functions with an overlapping decomposition, thus succeeding in 
proving stability more often than when the vector Lyapunov functions are based 
on a disjoint decomposition of the system. 
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2.3.3 Nyquist Array Method and Diagonal Dominance 


The Nyquist Array Method is a frequency domain method that can be included 
in the category of nonsingular perturbation techniques. It can be regarded as an 
attempt to generalize to Multi-Input Multi-Output (MIMO) systems design 
techniques developed for Single-Input Single-Output (SISO) systems, and which 
are based on the Nyquist or the inverse Nyquist diagram [Ros74j. The Nyquist 
stability criterion [Daz81] for SISO system is primarily an analysis tool: given a 
system, the Nyquist contour will tell whether or not the closed loop system is 
stable. The Nyquist contour contains, however, much more information, and it 
allows one to understand in more details how stability can be achieved. Bode 
design techniques have been derived to that effect and the Nyquist contour has 
led to the development of synthesis tools. For a MIMO system, the Nyquist 
contour plots the determinant of the return difference matrix [Mac89]. The 
return difference matrix is the loop transfer function ( plant and compensator in 
series) plus the identity matrix. The determinant is a complicated function that 
makes it impossible, in general, to understand how loops interact and influence 
stability. By diagonalizing the matrix at every frequency, one obtains l 
eigenvalues, functions of frequency, where l is either the number of inputs or 
outputs, depending on where the loop is broken. Each eigenvalue can be plotted 
in the Nyquist plane, and it is shown in [Ros74] that the number of encirclements 
of the critical point by the product of the eigenvalues is equal to the sum of the 
encirclements of that point by each of the eigenvalues. Hence, upon 
diagonalization, the stability conditions can be checked by studying the phase 
and gain properties of each eigenvalue taken as a SISO system. The Nyquist 
Array Method refers to the splitting of the MIMO Nyquist test into a set of 
simpler SISO Nyquist tests that can be obtained, for example, by diagonalization 
of the return difference matrix. Simpler procedure can, however be found. 

Diagonalizing the matrix transfer function at every frequency is 
impractical and the Nyquist Array, or an approximation of it, cannot be obtained 
without some simplifying assumptions. The notion of diagonal dominance 
provides a simple measure of how close a matrix is to a diagonal operator. A 
matrix is row (column) diagonally dominant if the norm of each diagonal 
element is greater than the sum of the norms of the off-diagonal elements located 
on the corresponding row (column). The eigenvalues of a matrix are contained in 
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the Gershgorin circles, [Ros74, Mac89], which are circles centered on the diagonal 
elements of the matrix and whose radii are the sum of the norms of the off- 
diagonal elements. Considering the return difference matrix, and varying the 
frequency, the corresponding Gershgorin circles will describe bands, and each 
Gershgorin band will contain the Nyquist contour of an eigenvalue of the return 
difference matrix. The diagonal dominance property ensures that the bands will 
not contain the origin. Consequently, the number of encirclements of the origin 
by the eigenvalues of the return difference matrix is equal to the number of 
encirclements of the origin by the centers of the circles, which are also the 
diagonal entries of the return difference matrix. A simple sufficient condition for 
stability can be therefore derived, which does not involve the eigenvalue 
decomposition, or the inversion, of the return difference matrix. The first part of 
the computation consists of checking for diagonal dominance of the return 
difference matrix. This is equivalent to checking the diagonal dominance of the 
loop transfer matrix, since the difference between the two matrices is the 
identity. The next step consists of applying the SISO stability criterion to the 
diagonal entries of the return difference matrix using the origin as the critical 
point. This is also equivalent to applying the criterion to the diagonal entries of 
the loop transfer matrix using —1 as the critical point. The inverse Nyquist 
Array criterion consists of plotting the inverse of the diagonal entries. This 
sometimes results in better graphical appearances for the contours, but it is 
exactly similar in terms of interpreting the plot [Mac89]. 

The first step of the design procedure presented in [Ros74] is to tailor the 
matrix transfer function. Starting from a physical input output matrix transfer 
function, one uses pre and postcompensation as well as recombination of the 
physical inputs and outputs to obtain some matrix transfer function as diagonally 
dominant as possible. The inputs to the new system are thus the inputs to the 
precompensator and the outputs are those of the postcompensator. Inner loops 
can be closed to modify the input output characteristics of the plant. The whole 
purpose of these operations is to minimize the sum of the norms of the ofi- 
diagonal elements of the rows (or the columns) of the matrix transfer function 
defined between the new inputs and the new outputs to enforce diagonal 
dominance. A set of feedback gains is then chosen so that the Nyquist stability 
criteria are satisfied. The method can handle nonlinearity since the Popov circle 
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criterion can be extended to the MIMO case the same way the Nyquist criterion 
was. The control law is connectively stable, meaning that the actual values of 
the off-diagonal elements of the closed loop matrix transfer function are not 
important as long as the matrix satisfies the diagonal dominance property. The 
main drawback of the method is that there is no really straightforward way to 
achieve diagonal dominance. Computer aided tools have been developed to help 
obtain diagonal dominance [Mac89]. Pseudo-diagonalization, [Ros74, Mac89], 
consists of trying to make the plant transfer function diagonal using 
compensation, and it is very similar in essence to the idea of [Sin78] to use a 
global controller to decouple the subsystems constituting the overall system, and 
the same restrictions apply. Performance, disturbance rejection, control effort 
and compensator bandwidth are also difficult to understand, especially if a lot of 
pre and postfiltering has been used. The procedure generates potentially 
conservative design since it is based on a sufficiency test. 

The procedure of [Oth86] is similar to that of [Ros74] but has relaxed 
dominance conditions. The property is called quasi-block diagonal dominance. A 
diagonally dominant matrix always satisfies the quasi-block diagonal dominance 
criterion but the reverse is not true. The methodology presented in [Oht86] 
includes the possibility to decompose the matrix transfer function into 
overlapping blocks. The restrictions about the noncooperation of the 
connc.iively stable decentralized control applied for the methodology of [Sil73l. 
But, again, benefits are to be expected by making an overlapping decomposition 
of the system [Sil79]. In that case, the system input vector as well as the output 
vector are partitioned into subsets of inputs and subsets of outputs. The reason 
for expecting better performance with an overlapping decomposition is similar 
whether the approach a frequency domain or a time domain approach: local 

controllers are built using more structural information. 

The local LQG/LTR design methodology presented in [Ift87] uses block 
diagonal dominance properties even though the problem is presented in a 
stability robustness setting. The overall state vector is partitioned into possibly 
overlapping subsets to define the subsystems. For every subsystem, the coupling 
with the rest of the system is translated in terms of a multiplicative error which 
is then bounded by some upper bound function of frequency, e(a>). A standard 
LQG/LTR procedure is then applied to each subsystem, where e(u/) is used for 
the stability robustness test [Ath86], The procedure guarantees stability of the 
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overall system since the gains have been chosen in such a way that the outer 
loops cannot destabilize the local subsystems. 


2.3.4 Singular Perturbation Methods: the Multi-Timescale Approach 

Singular perturbation theory applies to systems which have well separated 
spectra [Sak84]. In that case, systems separate into a distinct slow and fast part. 
When the time constants of the slow and the fast system are well separated, 
simplifications occur. A global slow system can be built by assuming the fast 
dynamics to be infinitely fast and considering the corresponding dynamic 
equations to be algebraic relations between state variables. This produces a 
reduced order aggregate model that describes the slow behavior of the system. A 
control system can be derived based on the reduced order model. The resulting 
control will have a low bandwidth. Considering the fast dynamics again, a fast 
behavior will be observed on top of the slow dynamics. A fast part can be added 
to the control in order to cancel the fast dynamic effects relative to the slow 
behavior. [Chw76] applies the singular perturbation techniques to derive a near 
optimal two timescale LQR solution in the deterministic case while [Ten77j 
treats the same problem in the stochastic case. Such composite controllers are, of 
course, suboptimal. The degree of suboptimality is estimated in the 
deterministic case in [Chw76]. In [Ten77], it is shown that, as the perturbation 
tends toward zero, the suboptimal closed loop system tends asymptotically 
toward the optimum. The advantage of the multi-timescale techniques is that 
they simplify the design procedure by breaking it into two simpler steps, one for 
the slow part of the control, one for the fast part, and only reduced order models 
need to be considered in each case. The control that results from this procedure 
is naturally hierarchic: The slow modes are controlled with a reduced order 

controller and with a relatively small bandwidth. The state of the overall system 
is extrapolated from the reduced order model and the lower controller tries to 
reduce the fast errors between the desired trajectory which is the result of the 
extrapolation and the actual trajectory. The two timescale case can be extended 
to a multi-timescale case (with more than two timescales) to get more resolution, 
as shown in [Ozg79]. The design method can be used iteratively to design 
controllers operating with different bandwidths. This should improve the degree 
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of suboptimality, as more structural information is used to derive the control 
system. More recent developments have considered multi-timescale LQG 
controllers (based on multi-timescale state estimators) and multi-timescale filters 
[Kha84, Kha87j. Decentralized multi-timescale compensators have also been 
investigated [Kha80]. The approach has also received a frequency domain 
treatment in [Lus85], leading to a multi-bandwidth design procedure. 

Restrictions apply to the use of multi-timescale design techniques. The 
closed loop system must be multi-timescale with bandwidths similar to those of 
the open loop system. This is not, however, a very limiting restriction in the case 
of a large flexible structure since the amount of control one can get from the 
actuators is usually limited, and very high gains are not conceivable. The second 
problem is to evaluate how suboptimal the design is. This is highly dependent on 
the choice of the fast and the slow system and on the bandwidth separation. The 
intermediate dynamics can potentially be driven unstable and will generally 
result in poor overall performances. One really needs asymptotic separation of 
the bandwidths to implement the method successfully. 


2.4 SIMPLIFIED COMPENSATOR DESIGN 


2.4.1 General 

The complexity and size of the problem may dictate the use of simplified 
compensator structures, even though the plant does not have any properties 
leading naturally to a simpler design. This is the case when the coupling between 
subsystems is not weak enough, or when the system does not have two clearly 
separated time scales. Nonclassical information pattern in the feedback loop is a 
common way of simplifying the controller structure [Chg71]. The information 
pattern is called nonclassical when the control law that drives a given actuator is 
based on a limited knowledge of the outputs of the system and a limited 
knowledge of the actions of the remaining actuators. In the decentralized control 
case, the control inputs driving a given subsystem are functions of the outputs of 
that subsystem only. The simplification of the controller structure results in a 
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tremendous complication of the control design procedure. As reported in [San78, 
Sin78, Sin80], the optimal LQR compensator with nonclassical information 
pattern is nonlinear. Nonlinear feedback is not a practical solution, and a more 
common approach is to consider linear feedback laws with constrained 
information structures. Assuming the feedback to be linear does not, however, 
solve all the problems since the separation principle does not hold anymore when 
the information structure is constrained [Chg71, Hyl84], The optimization 
process is therefore intrinsically more difficult. 


2.4.2 Stabilization and Pole Placement 

The existence of a centralized stabilizing compensator is guaranteed if the system 
under consideration is both detectable and stabilizable. The order of such a 
compensator has a lower bound as shown in [Bra70]. The compensator is, 
however, centralized: the information coming from all the sensors is 

simultaneously processed to generate the input commands for all the actuators. 
Stabilizability and detectability do not guarantee that there exists a compensator 
with the given constrained architecture that will stabilize the plant. The notion 
of fixed poles generalizes the notion of observability and controllability for LTI 
systems with fixed architecture controllers [Wan73]. For a given feedback 
architecture, the fixed poles are the poles that do not move when the control loop 
is closed. When the feedback is centralized, the fixed poles are just the 
uncontrollable and the unobservable poles. One method to determine the fixed 
poles is to close the control loops with the required architecture using direct 
output feedback with randomly selected gains. The fixed poles will always be left 
unchanged. Hence, they have probability one to be detected with such a 

procedure [Wan73]. 

A system with stable fixed poles can be stabilized by dynamic output 
feedback with the chosen architecture. When the orders of the subcontrollers ar? 
chosen appropriately, the poles of the closed loop system which are not open loop 
fixed poles can be freely assigned [Wan73j. These results permit to extend the 
robust servomechanism problem [Dav76a] to the robust decentralized 
servomechanism problem [Dav76b]. The robustness is defined as the property for 
the control system to remain asymptotically stable and regulate with zero steady 
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state error in the presence of steady disturbances and steady structural error. 

[Wes84] specializes the decentralized servomechanism problem to large 
space structures. The results were derived assuming sets of dual sensors and 
actuators. Under these conditions, it is shown that the decentralized robust 
servomechanism has a solution if and only if the centralized robust 
servomechanism has a solution, in other words, if and only if the rigid body 
modes are controllable and observable. An other very interesting result is that it 
is possible to design a decentralized controller for which the unmodeled higher 
order modes will not be destabilized. 

The study of [Cor76] gives another complete set of conditions for stability 
and pole placement using decentralized control. The approach is to determine 
conditions under which a system made of interconnected subsystems can be made 
controllable and observable from the inputs and outputs of one particular 
subsystem. Loops are closed around the other subsystems in order to modify the 
coupling and make the entire system controllable and observable from the 
actuators and sensors of the selected subsystem. Once the controllability and 
observability conditions are met for the selected set of sensors and actuators, 
dynamic compensation can be used to place the closed loop poles. 

All the existence theorems proving that pole placement is possible under 
certain conditions are very important from a theoretical point of view, but they 
have very little applicability when design is concerned: the performance of the 
closed loop system is indeed hard to translate in terms of eigenstructure 
specifications. The order of the design may also be quite high. Performance 
oriented, or optimality based techniques are better suited for design purposes. 


2.4.3 Optimality Based Simplified Compensator Design Techniques 

One common approach to designing compensators is to define the performance of 
the system in terms of a cost index and try to find the compensator minimizing 
that cost. Linear Quadratic techniques have yielded very powerful MIMO design 
tools and the solution procedure has become very efficient. The control they 
yield is centralized and the order of the compensator is equal to that of the plant 
and larger is frequency shaping of the cost is used [Gup80]. The resulting 
controller may be too complex if the plant itself is very complex. The next 
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sensible step is to find the best compensator that satisfies the implementation 
requirements. 

[ChgTl] considers the design of a near optimal decentralized LQG design 
by replicating the centralized LQG solution: each compensator runs an unbiased 
estimator of the plant state vector and the controls generated by one 
subcontroller are linear combinations of these state estimates. The determination 
of the various gains involve solving coupled modified Riccati equations. The only 
advantage obtained with the scheme of [ChgTl] is that the information pattern is 
somewhat simplified. The overall control must however maintain several full 
state estimators and cannot be realistically implemented if the order of the plant 

is lsir§6. 

A more general approach consists of fixing the structure of the 
compensator as well as its order such that it represents an acceptable level of 
complexity, and solve the constrained LQR and LQG problems as a parameter 
optimization problem. Reduced order optimal H 2 compensators have appeared 
early in the literature, [Lev70, Joh70], following the development of the un- 
constrained quadratic methods. They have raised the interest of many [And71, 
Bas75, Men75, Ly82, Kab83, Hyl84, Ly85, Moe85, Kra88, Cal89]. Most of the 
work has been centered on finding reduced order compensators. In [Wen80, 
Ber87b], however, the information pattern is specified as well. [Wen80] contains 
the most general control structure, whereas [Ber87] studies locally decentralized 
controllers (no overlapping information allowed). First order necessary 
conditions for optimality can be easily derived. Solving them is a very difficult 
optimization problem. Few theoretical results have been found to explain the 
nature of the solution and the properties of the controllers one can obtained 
through these direct methods. Only with the more recent efforts of Hyland and 
Bernstein has one tried to explain the structure of the problem and shown how it 
is closely related to the full order LQG problem [Hyl84]. When the compensator 
is full order, the classical LQG problem reduces to solving two uncoupled Riccati 
equations of order equal to that of the plant. When the order of the compensator 
is smaller than that of the plant, it is shown in [Hyl84] that the solution to the 
optimal problem consists of solving two full order modified Riccati equation: 
coupled by two modified Lyapunov equations via a projection operator whose 
rank is equal to the order of the compensator. The projection tries to determine 


41 



the best subspace in the plant state space where control should be performed. 
The determination of the projection is an integral part of the optimization 
process [Hyl84]. Attempts have been made to use the structure of the equations 
and the projection in order to develop better algorithms for solving the 
constrained LQG problem [Hyl83, Ric89j. These numerical techniques do not 
generalized, however, to the decentralized control case. The results can also be 
derived for discrete time systems [Ber86c, Ber86d]. The optimal fixed order 
compensator problem can be stated for infinite dimensional plants as well 
[Ber86a], The optimality conditions can be transformed into two modified 
Riccati equations and two modified Lyapunov equations, all coupled through the 
optimal projection. Instead of matrices, however, these equations involve infinite 
dimensional linear operators. Due to the infinite dimension of the state space, 
one needs to call upon properties of linear operators in Hilbert spaces. The proofs 
are consequently more involved, and this result of theoretical importance has 
little application since a numerical solution requires the discretization of the 
problem. Nevertheless, it ensures that, by taking a large but finite dimensional 
approximation of the plant, and by solving the optimal projection equations for 
this model, one will find a compensator that tends asymptotically to the optimal 
solution as the order of the model is increased. The projection method has also 
been extended to the filtering problem [Ber85]. A more detailed review of the 
direct quadratic optimization approaches will be made in the following chapters. 

The numerical difficulties associated with the direct solution of the 
optimization problem have been a deterrence to many, and a simpler approach 
has been sought through indirect design methods. A large order compensator is a 
large scale system, and an approximate model can be derived for it using 
techniques similar to those used for simplifying the plant. Like in the model 
reduction case, many different approaches have been studied for reducing the 
compensator [Enn84, Liu86, Opd90]. The rationale behind designing a full order 
compensator first, and reducing it next, is that the higher modes of the plant are 
taken into account in the design process unlike in the case when the controller is 
based on a simplified model of the plant only. As the order of the compensator is 
increased, the optimal performance should be recovered and, by choosing a 
reduced order approximation as close as possible to the complete controller, one 
should limit the performance degradation to a minimum. 

Indirect procedures are much easier to implement that the direct 
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ones, but they lead to nonstabilizing compensators in many cases and the closed 
loop performance may often be unsatisfactory [Liu86]. As pointed out in [Ric87, 
Hyl90], designs obtained through direct methods always yield better performance 
and always stabilize the plant provided that there exists a stabilizing 
compensator in the class of compensators having the required order. The indirect 
methods cannot been generalized to the case of constrained information pattern. 


2.5 MULTILEVEL TECHNIQUES 


2.5.1 General 

The multilevel, or hierarchic, architecture appears as a natural way to control 
complex systems made of a large number of coupled subsystems. Hierarchies 
seem to be the preferred way of evolution for societies. Hierarchic organizations 
maximize the welfare of the group by making its constituting elements cooperate. 
Furthermore, the seemingly complex control structure breaks the processing 
down in such a way that each decision maker (i.e. controller) needs not have a 
complete understanding of the global system in all its details but only some 
partial knowledge of it [Chg76]. At the subsystem level, local controllers operate 
using local information and information supplied by a global controller. They 
supply in return the global controller with partial and condensed information 
about the local sensor outputs as well as the local actions they are taking. The 
global controller has perfect structural information about the system, and knows 
in particular how the subsystems interact. Given the information received from 
the subsystems, the global controller sends directives to each local controller so 
that more cooperation occurs within the system. Each subcontroller, be it at the 
local level or at the global level, operates with partial and simplified information, 
limiting the complexity of the control task for each decision maker. Such an 
architecture is very elegant, but the design procedure must take into account the 
entire model in order to distribute the tasks between the subcontrollers. The 
constraints on the information pattern will complicate tremendously the design 
procedure. 
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2.5.2 Periodic Coordination 


As argued by Chong and Athans in [Chg76], if the global controller can receive 
all the local information, the optimal solution will be for the global controller to 
cancel out the local actions and superimpose the centralized optimal solution. As 
a result, [Chg76] considers that the global controller operates at a smaller rate 
than the local controllers. Such a structure is called periodic coordination, since 
the directives arrive at the local level periodically every l time steps, where l is 
the ratio between the global controller sampling time and the local controller 
sampling time. Interconnected systems are considered in [Chg76] and the 
optimal Linear Quadratic solution with periodic coordination is studied. The 
control structure is as follows: local controllers drive local actuators based upon 
local information. The local control law would be LQ optimal if there were no 
coupling between the subsystems. At the upper level, the interaction between 
the subsystems is estimated, based on a priori information and past 
measurements. The update of the estimate of the interactions is done 
periodically every l steps. Two kinds of periodic control are developed in 
[Chg76]. The first one is qualified as open loop, meaning that the coordinating 
parameters are computed based on past information and without expecting future 
information. Thus, the estimate tries to minimize the mean error due to the 
interaction for all future times as if no more updates were able to refine the 
estimate. The second one is qualified as closed loop, meaning that future 
measurements are expected. In that case, the estimate tries to minimize the 
mean error due to coupling for the next l steps only, knowing that the estimate 
will be refined later on. The closed loop scheme is more complex to solve and its 
resolution does not decouple at the subsystem level. It should yield, however, a 
better solution. The method appears to be an elegant design method. Still, even 
if optimality is reached, little is known about stability. 
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2.5.3 Goal Coordination and Interaction Prediction Methods 


The problem considered throughout [Sin80] is the time varying LQR problem for 
interconnected systems. The computation of the optimal control sequence 
requires the knowledge of the full state variables. In order to simplify the 
computation, [Sin80] considers each individual subsystem separately. For one 
particular subsystem, the interaction of the other subsystems is a sequence of 
vectors which are linear combinations of the states of the other subsystems. 
These vectors can be defined as new variables. Additional variables must also be 
defined in that case. They are called coordination variables and are in fact 
Lagrange multipliers that are introduced in order to relate the interaction 
variables to the states of the subsystems from where the coupling arise. In the 
Goal Coordination Method, [Sin75, Sin80], also referred to as the Interaction 
Balance Method, the optimal control sequence is solved at two levels. At the 
lower, or subsystem level, one computes the optimal control sequence as if the 
subsystems were isolated. The coordination variables are used at the local level 
as parameters for the local minimization problem that generates the local control 
sequence. At the upper level, the coordination variables are updated in order to 
optimize the overall cost of the interconnected system. The updating process is 
truly a minimization algorithm. The gradient of the cost relative to the 
coordination variables is computed at the subsystem level and is used in the 
upper level in the optimization procedure. The optimum is found recursively by 
first assuming a value for the coordination variables, then by computing the 
gradient of the cost at the lower level, solving only reduced order minimization 
problems. A different scheme attributed to Takahara is referred to as the 
Interaction Prediction Method [Sin75, Sin80]. The method uses both the 
aforementioned coordination variables as well as the coupling variables to define 
the coordination vector between the local and the global problem. The 
computation is carried out like in the Goal Coordination Method by assuming a 
value for the coordination vector at the upper level and by computing the 
gradient of the cost at the lower level. Convergence properties are enhanced 
when the coupling variables are not eliminated in favor of the coordination 
variables. 

Both multilevel techniques require the iterative computation of a 
minimum at each time step. A high rate of convergence is reported using either 
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method for fairly complicated systems. Both methods are so-called infeasible 
methods [Sin75, Sin80] since the coupling variables introduced in the problem are 
equal to the real coupling only when the solution is reached. The main drawback 
of such methods is that suboptimal control sequences cannot be obtained by 
relaxing the accuracy on the determination of the minimum at each time step. 
Such a control sequence could very well destabilize the plant and does not satisfy 
any of the problem constraints. Therefore, the expected reduction in 
computation time due to the breaking down of the large minimization problem 
into simpler reduced order problems may very well be overestimated because of 
the need to reach accurately a minimum at each time step. The complexity of 
the implementation is not addressed either. The time varying problem is solved 
as an open loop problem. The feedback problem can also be solved. The same 
procedure is used, but the control at the subsystem level is a function of the local 
states and the coupling variables. The gains are computed in a recursive manner, 
using the coordination technique. The main advantage is that they require the 
resolution of only reduced order Riccati equations, whose calculation grows much 
faster than linearly with the order. The control that comes out of the procedure 
is a centralized full state feedback LQR, and is therefore not suitable for 
implementation. 


2.5.4 Hierarchic Control with Distributed Sensors and Actuators 

Hardware and implementation considerations have led to the development of last 
class of controllers reviewed in this chapter. [Hal90, How90] have considered 
structures with distributed sensors and actuators. The premise that such sensors 
and actuators can be built has been suggested by the advances in piezoelectric 
materials. The deformations of a piezoelectric layer transforms the local strain 
into a voltage which can be measured. Similarly, a voltage applied locally will 
produce a force on the structure. Hence, distributed action on the structure can 
be obtained. Hierarchic control appears, in that case, to be the only approach 
that can utilize the unique possibilities offered by distributed sensing and 
actuating capabilities while producing a control structure of acceptable 
complexity. The method becomes optimal if there is a frequency gap in the 
spectrum of the structure and if the higher modes do not propagate and can be 
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controlled optimally with local control only. The method is therefore related to 
that of [Ozg79], even if the latter is not developed directly in terms of a 
multilevel control. In [Hal90, How90], the upper level controller receives 
condensed local information from which it estimates the global motion of the 
system. Such a global motion is made of the slow modes of the structure. The 
upper level controller fights low frequency perturbations that affect the entire 
system in a very coherent way. The global level sends back to the local 
controllers the global shape of the system. The local controller will then take out 
high frequency perturbations that affect the global modes. High frequency 
perturbations have a tendency to be localized and be less coherent over the 
structure, which is why they can be eliminated by simpler local controllers. 
Fairly simple proportional plus derivative feedback on the local displacement 
variables is used at the lower level. The upper level also coordinates the lower 
level controllers and makes sure they do not excite the lower modes by 
eliminating the slow coherent residual effects generated by the local control laws. 
The control input at each point is the sum of the coherent part coming from the 
upper level and the local part that has been cleaned of its residual coherent part. 
The drawbacks of the method are the same as those pointed in section 2.3.4: 
good control of the slow and fast modes is achieved, but intermediate modes may 
be affected adversely. The method will work better if the structure has well 
separated slow and fast modes. Nevertheless, the method does take into account 
more of the physics of the problem and yields a control law that is implementable 
with the type of technology envisioned in [Hal90]. 
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OPTIMALITY CONDITIONS FOR THE 
H a FIXED ARCHITECTURE CONTROL 


3.1 INTRODUCTION 


The control design methodology presented in this work is a generalization of the 
well known LQG design methodology. The LQG methodology has been 
extensively studied and applied to design Multi-Input Multi-Output feedback 
regulators. It constitutes a good design tool for the following reasons: 

— the optimal solution is a linear time invariant feedback system with a rational 
transfer function. Its dyn ami cs happen to have the same order as the plant. The 
closed loop system is asymptotically stable under detectability and stabilizability 
assumptions. 

— the design is a truly Multi-Input Multi-Output feedback system and all sensors 
and actuators are included at once in the design procedure. 

— the design parameters provided by the designer have physical meanings which 
leads to an insightful iteration of the design. These parameters include a model 
of the disturbance entering the plant, the definition of the outputs that must be 
regulated and a scaling of their respective importance in the overall performance 
of the system. It also includes a scaling of the amount of energy one can require 
from each actuator and information about the amount of noise that corrupts the 
measurements of each sensor. All these design parameters can be related to 
physical data in terms of noise intensities or energies. 

— finally, the solution to the problem is unique. One must solve two Riccati 
equations to find the solution and there now exists very reliable algorithms for 
solving such equations. The LQG methodology is therefore very appealing and 
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easy to use for designing stabilizing multivariable feedback laws. 

The method suffers, however, many drawbacks and has little practical 
applicability to the control of large flexible structures for example. One main 
drawback is that it may result in feedback systems of very high orders and high 
complexity. The data processing capabilities of existing flight qualified 
computers will be rapidly exceeded. Furthermore, the wiring might be too 
complex and the testing impossible. Finally, such complex control systems are 
prone to more failures. A second drawback is that these high order designs may 
not be robust since nowhere in the optimization procedure is it stated that the 
model may be incorrect. In order to design an LQG compensator for a large 
structure, one can include more vibrational modes in the model in order to 
encompass potential spillover problems. The LQG solution must then have more 
modes as well, and the design of the controller will rely on modes which are 
increasingly more poorly modeled. The result may be a compensator finely tuned 
to the wrong model and which in reality misinterprets the information it receives, 
thus potentially driving the closed loop system unstable. 

The Optimal H 2 Fixed Architecture Control Design approach is a direct 
attempt to resolve the problem of controller complexity while it tries to retain 
some of the best features of the LQG design methodology. The idea of 
constraining the order or the structure of the LQG solution has appeared 
repeatedly in the literature. The reduced order compensator problem has 
received most of the attention [Joh70, Men75, Kab83, Hyl84], Some schemes for 
constraining the architecture have, however, also been proposed in [Wen80], and 
in a less general way in [Ber87b]. The fixed architecture control design problem 
consists of setting the control problem as the optimization of some H 2 norm of 
the closed loop system similar in every way to the H 2 norm considered in the 
unconstrained LQG problem. The difference is that the solution is required to 
have a given architecture which is specified in advance. Typically, the feedback 
system is made up of p independent processors which cannot co mm unicate 
between each other. Each processor has also limited memory and can only realize 
a transfer function which has a fixed number of poles. Finally, each processor is 
connected to some selected sensors and actuators. The choice of the number cf 
processors, number of poles and the selection of the sensors and the actuators is a 
trade-off between the simplicity of the feedback system and its performance. The 
choice of the architecture will also influence the difficulty of numerically finding a 
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solution. The fixed architecture design is a suboptimal solution when one 
considers the unconstrained problem. Hence, the solution will not be as highly 
tuned to the problem as the overall optimal solution. This may ensure better 
robustness properties, even though there is not a guarantee since the robustness 
requirements are not included in the optimization procedure. Some attempts 
have been made to generalize the LQ methodologies to deal with robustness 
issues, [Ber86d, Ber87a, Che88], but it is out of the scope of this research whose 
principal focus is to understand the effects of imposing architecture constraints 
on the controller. 

The H 2 optimization problem is stated in the first part of the chapter. A 
Lagrangian is defined for the problem and the architecture constraints are 
incorporated. Tools necessary for the derivation of the optimality conditions are 
presented in the following section. These are rules of calculus that apply to 
matrix spaces and are used to differentiate the Lagrangian of the problem. 

The LQG methodology generates dynamic compensators which are strictly 
proper. Hence, the transfer functions always roll off at high frequencies. The 
method cannot handle static output feedback since it assumes that each sensor is 
corrupted by white noise. The direct feedback of white noise into the system 
would make the cost infinite. This forces the sensor outputs to be filtered. The 
LQR methodology, on the other hand, does not consider the measurements to be 
corrupted by noise and it can be seen as a static output feedback scheme, where 
it is assumed that all the states can be independently measured. The 
generalization of the method is a fixed architecture, static output feedback 
scheme. The H 2 , Fixed Architecture, Static Output Feedback problem is derived 
in the chapter for the sake of completeness. The first and second order 
optimality conditions are given in Section 3.4. 

Finally, in order to motivate the use of Optimal Fixed Architecture 
Control, some examples of possible control architectures are presented in Section 
3.5, such as decentralized, hierarchic or fixed dynamics compensation. 
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3.2 PROBLEM STATEMENT 


3.2.1 The H 2 Optimal Control Problem 

Consider the n-dimensional linear time invariant plant with m inputs and 1 
outputs: 


X = AX + B1U1 + B2U2 + • • • + B B u m + w 


y 1 = CiX + vj 
y 2 = C 2 X + v 2 


yi = CiX + vi 

where A € R n * n , Bi e R n “*, Cj € R** n . w e R 11 is a white process noise vector 

whose covariance is a symmetric positive semidefinite matrix V € R n * n Each 
measurement yi is corrupted by a white measurement noise Vi whose variance is 
Vi 6 R. Gathering the input signals ui, U2,* • *, u m as well as the measurement 
signals y 1, y2,* • yi into two vectors u and y, the plant model becomes: 


where: 


X = AX + Bu + v 
y = CX + v c 



re; 



B = [Bj B2 • • • B m ] , C = 

C 2 


v 2 

Cl 

> V C = 

VI 


E{v c Vc} = Vctf(t) 


In order to modify the closed loop characteristics of the system, one wishes to 
implement an LTI feedback loop. The control law has the generic form: 
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X c = A c x c + Ky 
u =GX C 


where Xc is the compensator state vector, A c € R 1 ^ ttc is the compensator 
dynamics; K e R ncxl corresponds to the filter gains; G 6 R m * nc corresponds to the 

control gains. 

The performance of the closed loop system is established by looking at a 
quadratic cost J that penalizes both plant states and control effort: 


J = lim j t E{ [ X(r) T HX(r) + u(r) T R c u(r)dr }, 
t -* ® J 0 


where R 6 R n * n is symmetric positive semidefinite, Rc € R m m is symmetric 
positive definite, E{-} is the expectation operator. The same cost J is obtained 
when one considers the plant to be subjected to deterministic disturbances, by 
integrating the energy X(r) T RX(r) ♦ u(r) T R c u(r) over an infinite period of time 
as the perturbations w(t) and v(t) (formerly process and measurement noise) are 
two vectors of impulses equal respectively to w(t) = VV6(t) and v(t) = JV c 6{i). 

denotes the square root of the symmetric positive matrix X. J is therefore the 
square of an H 2 norm defined for the closed loop, and the cost functional is a 
general quadratic cost that can have several interpretations. Following the 
stochastic interpretation of the problem, J can equivalently be written as: 

J = lim jE{ X(t) T RX(t) + u(t) T R c u(t) } 

t "♦ OD 

One wishes to find Ac, G and K that minimize the cost J. If no other constraints 
are imposed on the control loop and if n c , the number of poles in the 
compensator, is free, the problem is the standard LQG problem. 
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3.2.2 Constrained Control Architecture 


LQG designs are not always satisfactory and cannot be implemented in many 
cases. To make the control simpler the following constraints are introduced: the 
processing of the control law is distributed among p smaller processors. Each 
processor has a limited memory or, in other words, each processor has a limited 
number of integrators to realize its transfer function. The order of the i th 
processor is denoted m and is fixed by the designer. The information flow and 
the control authority are also limited. Each processor is connected to a selected 
set of sensors and actuators. The set U\ contains mi elements which are the 
indices of the mi actuators that are connected to the i th processor. The number 
mj and the indices in U\ are specified by the designer. The set 7i contains li 
indices which are the indices of the h sensors connected to the i th processor. The 
number li and the indices in are also specified by the designer. The overall 
feedback loop will therefore be described as follows: 


1) Processor i is described by its own state vector Xi which is ni dimensional. 

2) The global compensator is the aggregation of the Xi: 


X c = 


r x ii 
X 2 


t PJ 


3) The matrix A c is block diagonal: 


A c 


Aj 0 • • • 0 

o a 2 0 

• • • « 

• • # ♦ 

0 0 • • • Ap 


(3.2.1) 


where Ai e R nixni describes the internal dynamics of processor i. 

4) G and K can be block partitioned in, respectively, m times p row vectors and 
p times 1 column vectors: 


G = 


G n G 12 
G 2 i G 22 


G i p | 

G 2p | 


, Gif 6 R lxn j 


[Gml Gm2 • ■ • G 


mpj 
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( 3 . 2 . 2 ) 


K 11 K 12 • • • K a 
K21 K22 • * * K21 

K = 

• • • 

• • • 

_K p i K P 2 • • • Kpi 


Kij € (R 


ni*l 


where Gij = 0 lxn . if i i tfj (the i th control input Ui does not use Xj) and where 

Kjj = 0 . if j t /i, (Xi is not driven by the output signal yj). 

ni*i 

Define the following matrices Hi and 7r^: 


Hi = TO . . • 0 10 • • ■ 0 1 e 01 

1 L ni«ni njxni-i ni ni*ni*i ni*n p J 


Ui*n c 


7T^ = [0 • • • 0 1 0 • • • 0] € R 

1 i element 


Consider a matrix having n c rows partitioned in p blocks of n^ n2,- • *,n p rows. 
Premultiplying by Ili isolates the i 1 ^ set of ni rows. Considering the transposed 

T 

matrix and a partitioning of its columns, postmultiplying by Hi corresponds to 
isolating the i th set of ni columns. Premultiplying by provides the i th row of a 
matrix, postmultiplying by its transposed provides the i th column. Using the 
matrices defined above, the architecture conditions can be expressed more simply 
as: 


7r®GIIj T = 0. „ «=> if Hi 

i J l*nj J 

= ** J** 

The i th subcontroller has the following dynamics: 

Xi = AjXi + E K ijyj 
j€?i 

The k th control input is a linear combination of the state vectors of the 
subcontrollers to which it is connected or, in other words, it is the linear 
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combination of the Xi such that k e U\\ 

Uk = S Gki^i 

i:k€^i 

Take, for example, a plant with 3 inputs and 3 outputs and assume that the 
feedback loop is made of two second order processors such that: 

1) measurements 1 and 2 are available to processor 1: y x = { 1, 2} 

2) measurements 2 and 3 are available to processor 2 : = { 2, 3} 

3) actuators 1 and 2 are driven by processor 1: U\ — { 1, 2} 

4) actuators 2 and 3 are driven by processor 2: lli = { 2, 3} 



Figure 3.1: Example of Feedback Architecture 


The feedback architecture is shown in figure 3.1. The corresponding K, A c and G 
have the following form: 


A c 


'X I 0 O' 

X X 0 0 
OOXX ’ 
0 0 X X 


'X X o' 
v X X 0 
* = OXX 
0 X X 


G = 


'X X 0 o' 
X X X X 
OOXX 


where an X denotes a free entry. 
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3.2.3 Lagrangian F ormulation and Problem Statement 


The cost functional J is a scalar quantity and it is therefore equal to its trace. 
Hence: 

J = Tr( J) 


i Tr[ lim E{ X T RX + u T R c u } 
1 L t-*® 


= i Tr [r E{ lim XX T } + R C E{ lim uu T }] 

^ t“*0D t-*0D ^ 

Defining 

X c i = X , closed loop state vector, dimension n = n + n c 

LXcJ 

Q = lim E{X c iXci T }, 6 (R nxn , steady state, closed loop 

t -* <D 

covariance matrix, 


Ad = A BG , 6 closed loop dynamics, 

[KC A c J 


Rc! = R T ° , e R fixn , symmetric positive, 
0 G i R c G 


Vcl = V 0 T , 6 lR fi * fi , symmetric positive. 
[0 KV C K i J 
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the cost J becomes: 


J ~ 2 (3.2.4) 

where Q has to satisfy the steady state filter Lyapunov equation: 

°fi,n = AclQ + QAclT + Vcl (3.2.5) 

Eq.(3.2.4) is a much simpler expression of the cost than the integral formulation. 
One must, however, include the constraint of Q satisfying Eq.(3.2.5) in the 
problem. The triplet ( G, A c , K) is a vector in the product space (R m * nc , |R nc * nc 
« R nc ^. Adding two vectors in such a space is to add the corresponding matrices, 
the multiplication by a scalar is to multiply each matrix. One can verify by 
inspection all the properties of a linear space. Thus, the cost J is a functional on 
a vector space. The dependence of J on the control parameters arises directly 
from R c i and indirectly from Q. It is not possible to solve for Q in closed form 
by solving Eq.(3.2.5). The alternative is, therefore, to consider Q as a variable 
and use Lagrange multipliers. Eq.(3.2.5) appears as a set of n 2 constraints on Q, 
G, A c and K. Denoting by the matrix E = A c iQ + QA c i T + V c i, we define 
1/2 Pji to be the Lagrange multiplier associated with Ey. They correspond to 
the sensitivity of the cost to variations in the intensity of the disturbance 
affecting the closed loop system. The Lagrangian becomes: 

, fl fi 

L = J + j E E PjiEij, 

i*l j *1 

Regrouping the element P ij into an n»n matrix P, and recognizing in the double 
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summation the trace of a product, the Lagrangian becomes: 


L = jTr(QR c i + P(A c iQ + QA c i T+ V c i)) 

= ^ Tr(QR c l + PV c i + PQA c i T + A c iQP) (3.2.6) 

We can now summarize the H 2 , Fixed Architecture Optimal Control Problem. 


Problem 3.1:’ Given the LTI plant with m inputs and 1 outputs: 

X = AX + Bu + w 
y = CX + v c 

T 

where w is cl white uoise vector with E{ww } = V<5(t) ; Vc is white noise vector 
with E{v c v c T } = Vc£(t), and given the controller architecture specified by: 

p number of subcontrollers 

m maximum order of sub controller i 

set of indices of sensors connected to subcontroller i 
Ui set of indices of actuators connected to subcontroller i 

find G 6 R mxnc , A c 6 R nc * nc , K 6 f 0 ' 1 such that 


A c = blockdiag( Ai, A 2 , • • •, A p ), 

Ai6R nixni 


Gij * ^lmj ifi 

j= 1 ’ - - • ’ P 


K = l K >ili=l,...,p' Kij € R 11 *' 1 , 

K «-°n 4 .l 

j=l»- * '.I 



and find P, Q e R***° positive semidefinite, where Q is the closed loop covariance 
matrix, and P is the sensitivity of the cost to changes in disturbance intensities, to 
minimize the quadratic functional: 

L = | Tr(QR c i + PV c i + PQ A c i T + A c iQP) 
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where A c i, R c i and V c i are as before. The solution is a quintuplet 
( G, A C) K, P, Q) in the product space R m,nc « R nc * nc * R ncxl * R flxfl , R ftxfi 
The compensator , whose state space representation is 

X c — A C I C + Ky 
u = GX C 

will minimize the quadratic cost J o/Eq.(3.2.4) m 


As stated in [Hyl84], the cost is a positive quantity when there exists a stabilizing 
compensator. The optimization problem occurs on an open set and the 
Lagrangian is differentiable on this open set. Hence, the minimum of the cost 
will be obtained for a set of parameters that make the Lagrangian stationary 
[Kir70]. The necessary conditions for optimality are derived in the next section. 


3.3 DERIVATION OF THE NECESSARY CONDITIONS FOR OPTIMALITY 


3.3.1 Calculus in Matrix Space 


r*s 


3.3.1. 1 General on Matrix Spaces 

For any integers r and s, the space of r by s matrices R*"“ is a vector space. 
Indeed, one can add two matrices, multiply them by a scalar and verify that all 

the properties of a linear space are satisfied. The matrices Ef’ s form a canonical 

Kij 

basis of R r,s , where Ef ,s are defined by: 

Kij 

• - -0 0 0 * • • 0 1 


E k’ s 

K 'J 


■0 0 0- 
■0 1 O' 
■0 0 0 - 


. j 

• i 

• oj 

• 0 i row, 

• 0 ! 


(3.3. i; 


■0 0 0-" oj 

j column 
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where 


kij = r (i— 1) + j, 1 < i < r, 1 < j < s, 


The matrices e£’. s have a single index, ky 6 W, which is related to the location 
where the matrix has its nonzero element on the i th row and j th column. The 
relation that yields kij as a function of the pair ( i, j) consists simply of counting 
the elements of the matrix row by row, and it transforms the doubly indexed 

sequence ( i, j) into the simple sequence kij. For any M € R r * s , the following 

linear combination holds: 

r * s r s 

M = S My eF’ s 

kij-1 klJ 

where My is the element of M located on the i th row and j th column. We will 

denote by E f g = {E\’ s , E*’ s , •••, E the canonical basis on R r,s . If the 
elements of the matrix M are arranged in a r«s column vector m using a single 
index, then M is uniquely represented by the vector m which is the vector of 
components of M on the basis E. More generally, any vector is uniquely 
represented by the vector of its components on a basis which needs not be 
canonical. This leads to the following definition: 


Definition 3.1: Let S be a subspace of lR r,S , generated by a family of linearly 

independent matrices Eg = { Ei, E2,* • • , E n }, Ej € IR , S = span{Ei, E2, • • •, 
E n }. Then, for any M 6 S, there exists a unique n-dimensional vector 

T 

m = [mj, m2, • • • , m n ] 
n 

such that: M = E mjEj 

j«t 

We define the law * to relate any matrix M to the vector of its components m on 
the basis in which M lies as follows, and write : 

m = M*£g 

M = £g*m ■ 
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When S corresponds to the entire space and when one uses the canonical basis E 
defined before, the operation M*£ corresponds to taking each row of the matrix 
M, transposing it and stacking it into a column vector. 

The quintuplet ( G, A c , K, P, Q) is a vector in the product space S = 
0 t m,nc . (R ncinc i R ncl1 x R fi,fl « R fllfl and constitutes the variable of the 
optimization problem. The control architecture defines subspaces on (R m,n<: , 
R ncXllc (R n c*l Indeed, specifying the architecture consists of requiring that 
certain entries of G, A c and K be zero: clearly, if Gi and G2 in R m ,nc have 
common zero entries, so will A1G1 + A2G2. G lies therefore in a subspace Sq of 

R mxIlc , and using similar arguments, A c and K lie respectively in and S^, 

subspaces of |R nclinc and R nc< ^. One can define three bases, 

E q - {E^ lt EV • • $ 9 n g }, € R m,nc , 

E Ac = {E a „ E fl 2 ,- • .,E a „ a }, E a i € R^ 111 ", 

E k = {E* , E*i,- • ■ E t i cS Ilc ‘ 1 , 

for the three subspaces Sq, S a and Sj^. G, A c and K will then be uniquely 
represented by three column vectors 
g = G*E g 
<k ~ A c *£ a 
k = K *E k ° 

The most obvious basis vectors to consider for spanning Sq, S^ and S^ are 

canonical basis vectors of R m,nc , (R nc,ric and R nc ** respectively. Because the 
architecture only imposes zero entries in the different matrices, e g- e a , and E ^ 
can be formed by retaining the canonical matrices that have a 1 at a location i,j 
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corresponding to a free entry in G, A c or K: 

E m,n c 6 jp ^ Gij is free 

k i i VJ 


E? c ’ nc €^ A <=> 

Kij Ac 

Ek-J 1 6 % * 


A c is free 

ij 


Kij is free 


g, ac and k are then built by stacking up in a column vector the free entries of the 
matrices G, A c and K. The reverse operation consists of placing the free entries 
of G, A c and K which are stored in a more compact form in g, (h and k at their 
correct locations and completing the matrices with zeros. Take, for example, the 
control architecture of Section 3.2.2. Eq is made of the eight following matrices. 


and: 



G = 


G 1 1 G 12 0 0 

G21 G22 G23 G24 
0 0 G33G34 



<7. 


g = [Gu G 12 G21 G22 G23 G24 G33 G34] 


3 . 3 . 1.2 Representation of the Differential of a Function in Matrix Space 
The differential of a function F mapping a vector space V into a vector space \\ 
at a point xo 6 V is a linear operator from V to W. Consider that V and W are 
two matrix spaces, equal to R m,n , and R1 *p respectively. The function F from \ 
to W maps an m*n matrix into an l*p matrix and, for every M 6 lR m,n , F(M) is a 
matrix in OU'P. F can therefore be split into 1 times p functionals F i j from R m,n to 
IR: 


F(M) = 


r Fn(Mj 

F 12 (M) 

■ • • F i p (M) 

F 2 i(M) 

F 22 (M) 

... F 2 p(M) 

.Fn(M) 

Fii(M) 

... Fip(M) . 
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The differential of Fy taken at a point Mo, if it exists, is a linear form that maps 
Rm«n into the real line R. Hence, the differential of Fij at M 0 is given by m times 
n coefficients that uniquely define a linear operator from R m ‘ n to R. These m*n 
coefficients can be regrouped into a m*n matrix, Fy^(Mo) 6 R ml,n , that uniquely 
represents the differential of Fij at Mo [Ath68]. The matrix Fij^j(Mo) is, so far, 
only a convenient way to represent the differential of Fij, but it can also be used 
to calculate the first order variation of Fy about Fij(Mo) when the Trace 
operator is introduced. Perturbing Mo by eMi, one gets 

F ij (Mo + eil) = Fij (Mo) + eTrFy^Io) 1 !! + O(e’) 

The Trace operator appears naturally in this context, since the bilinear operator 

<M,N> = Tr(M T N) (3.3.1) 

defines an inner product on the matrix space R mfn [Ath68]. The inner product 
confers a Hilbert space structure to R® 1 * and, for any linear form f from R™ 1 " to R, 
including the differential of Fy, there exists a matrix F 6 R m,n that uniquely 
represents f which can be written as: 
f(M) = <F,M> 

= TrF T M 

Extending the notation, one can define the differential of the entire matrix 
operator F at Mo in the form of a matrix: 


Definition 3.2: Let F 6 R 1 ?, ie a matrix whose elements Fy are differentiable 
functionals on a matrix space R mIn . Denoting by Fi iM 6 R m *n the matrix 
representing the differential of Fy with respect to M at M 0 , the matrix Fw, 
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m(l*m)i(p«n)^ defined { n block form as: 

F i ij[ F i 2 m ••• F ipjj 

F 2 F 22fl • • ' F 2 p|| 

« • • 

• ; ; | 

.Fuji Fi 2^ ' ’ ’ ? ipjjJ 

uniquely defines the differential ofY at M 0 . The operator Mi -> F M -M b Mi 6 
R®*n, defined as: 


V M ‘ = 




TrFujiMi TrFi2jj Mi ••• TrFtpjj Mi 

TrF 2 i s T Mi TrF 2 2 M T M 1 ••• TrFjp^M, 

• • • 

_TrFnj|^Mi TrFi 2 j|^Mi ••• TrF ipjj MiJ 


is a linear map from R®* to R 1 ^. To first order in e, the value of F is: 


F(M 0 +eMi)=F(Mo) + eF M -Mi+0(£2) 


Definition 3.2 gives a representation of the differential of a matrix with respect to 
a matrix as well as a means to evaluate the differential for any perturbation. 
The differentiation rules, and especially the chain rule can be simply written 
using the notation: consider G: R®* -» R 1 *, and F: R1 *p - R r «, are two 
differentiable matrix functions. Then H: R® m -* R r,s , defined as, 

H(M) = F(G(M)) 6 R r «, M € R® ,n , G(M) € R 1 * 


is differentiable with respect to M and, for any Mi 6 R®* 1 *, H^Mi is given by. 
H m -Mi = F g -(G m -Mi), G m -Mi 6 Rl*P, 

This defines the composed operator: 
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3.3.1.3 Differentiation of a Quadratic Functional 

Consider the following quadratic functional f on R lf P defined by 


f (M) = Tr(M T RM + S T M + « T S + T) 


M, S € R 1 ^, R € R ll1 , T € Rp*p. Subtracting f(M<>) from f(M 0 +eMi), one gets: 


f (lo+eMj) — f (M 0 ) = ^[(Mo+sMO^CMo+eMO + S T (M 0 +eIi) + 

+ (I 0 +eIi) T S + T)1 - Tr(I 0 T RMo + S T I 0 + I 0 T S + T) 
= 2£Tr(RM 0 + S) 1 !^ + ^(I^RIO 


Thus: f M (M 0 ) = 2(RM 0 + S) 


3.3.2 Variation of the Lagrangian with Respect to P, Q, A c , G and K 

The form of X c i induces the following partitioning of P, Q and defining M = PQ: 


o 

o 

T) 

o 

n — 

Qoo Qoc 

LPcO P CCJ 

5 — 

.QcO Qcc. 


where Poo> Qoo> Moo € R n * n , Pqc, Qoc> Mqc 


M _ ("Moo M 0c ] _ pn 
’ LMco Mccj " Fq 

€ R“' nc , Pco. Qco, Mco € 


(3.3.2) 

R nc ‘ n , Pc C 


Qcc, M cc € R nc * n<: . Furthermore, 


Moo = PooQoo + PocQco 
Moc = P ooQoc + P OcQcc 
M c o = PcoQoo + PccQco 
Mcc — PccQcc + PcoQoc 
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one can expand the Lagrangian in three different ways: 

L = jTrP(A c iQ + QA C J + V c i) + jTrQRci (3.3.3) 

L = §TrQ(A c i T P + PAci + R c i) ♦ jTrPV c i (3.3.4) 

L = |Tr(G T R c GQcc + 2G T B T M 0c ) + 

+ jTr(P C cKV c K T + 2 M c0 C T K T ) + 

+ TrAc^Mcc + jTrRQoo + jTrPooV + TrAMoo (3.3.5) 

The variation of the Lagrangian with respect to P, Q, G, A c , and K can now be 
obtained straightforwardly using one of the expressions for L given above and the 
differentiation rules of a quadratic functional given in Section 3. 3. 1.3. When the 
derivatives with respect to one of the matrices is taken, the remaining ones are 
considered fixed parameters. V c i and Rci do not depend on P and Q, and 
furthermore they are symmetric. Lp is directly obtained from Eq.(3.3.3). Lq 
follows from Eq.(3.3.4). Eq.(3.3.5) splits the Lagrangian into a sum of different 


parts, each of which depends only on A c , G or K. 
L k is then obvious. The algebra yields: 

The derivation of , Lq and 

Lp = j(A c iQ + QA c i^ + Vci) 

(3.3.6) 

Lq = j(A c i T P + PAci + Rci) 

(3.3.7) 

L i = M<^c 

A C 

(3.3.8) 

Lg = R c GQcc + ® M 0C 

(3.3.9) 

L k = P CC KV C + McoC T 

(3.3.10) 

If the parameters G, A c , K , P and Q are modified by the quantities eGi, eA C i, 

£K b eP, and cQi, the Lagrangian is, to first order 
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(3.3.11) 


L(G+£6 1 ,Ac+£Aci,K-t-eKi,P+eP 1 ,Q+£q 1 ) = 

L(G,Ac,K,P ,q) + fTrL^ Aci + £TtLqGi + 

+ £TrLjKi + ETrlJPj + fTrL^, + 0(£2) 

Lq is an m*n c matrix that can be block partitioned like G, Eq.(3.2.2) 


v 


L/i Ln ' * ' 

<M1 VI 12 

Ln Ln • • * 

<*21 «22 


Mp 

} 2p 


j/y Itn * * * Lp 

V»mi l*m2 <*mpj 


’ L G„ 6 « 1 ”“ j 


(3.3.12) 


Similarly, l k is an n c «l matrix that can be block partitioned like K, Eq.(3.2.2) 


h- 


^11 ^12 
L K 2 i L K 22 ' 


V V • 

&pl Kp2 


,L Kil 
' L K 2 i 

• L Kpi 


, L ¥ € R 111x1 

Kij 


(3.3.13) 


3.3.3 First Order Necessary Conditions for Optimality 

The independent variables of the problem are the entries Py of P, the entries Qij 
of Q as well as the the entries of g, a\ of Oc and k\ of k. The partial derivatives 
of P, Q, G, A c and K with respect to those variables are respectively: 


E^i 6 E q , 

E ‘* e *A C 
E*i € E k 

Because the problem is stated on an open set [Hyl84], the first order necessary 
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conditions for optimality require that the Lagrangian be stationary for all 
admissible perturbations [Kir70]. Hence, the derivative of the Lagrangian with 
respect to all free variables is zero: 


L 

L 


i , . 

Lp-Pij = 

= 0 

1 J 

><; = 

Ln-Qij 

= 0 


Lp-G 

= 0 

9i 

G 9\ 


fli 

L Ac* Ac di 

= 0 

% = 


= 0 


The stationarity conditions become: 


0 = Tr(Lp T Ej^), i, j = 1, - - * ,il 

(3.3.14) 

0 = Tr(L Q T Ej^), i» j = 1> • * ' 

(3.3.15) 

0 = Tr(L A Vi), isl,-,n 4 

(3.3.16) 

0 = Tr(L 6 T E 5 i) , i = 1,* • • ,n^ 

(3.3.17) 

0 = Tr(L K Vi), i = l,---,n fc 

(3.3.18) 


Eq.(3.3.14) just states that all entries in Lp must be zero, and similarly, 
Eq.(3.3.15) states that Lq must be zero. Eqs.(3.3.15-17) imply that the entries 
of Lq, L^ and L^ corresponding to free entries of G, A c and K must be zero. 
Ac is a block diagonal matrix. Eq.(3.3.16) thus states that the diagonal blocks of 
L. must be zero. Using the block partitioned forms of Lq and L K , Eqs.(3.3.17- 
18) become: 

0 1 — L r 

l*nj vjij 

= 7 r"j> Lq Hj T , for i G #j 

0 i = Lr, 

ni*l ftij 

= Hi L^ 7rj T , for j G y i 

Using the developed forms of Lp, Lq, L^, Lq and Lj^, Eqs. (3.3.6-10), the 
optimality conditions become: 
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Proposition 3.1: The matrices P, Q, G, Ac and K form a stationary solution of 


Problem 3.1 if the following conditions hold: 

= A ^ Tp + p Ad + Rci (3.3.19) 

0 flxfl = AciQ + QAci 1 + V c i (3.3.20) 

°nixni = Mii = n i*ccni T , 1< i < p (3.3.21) 

0^ xn . = TT^RcGQccHj + Bj Moj, i € U j (3.3.22) 

0 n . x i = IliPccRVcxj + M ioCj , j 6 (3.3.23) 


where Poo. Qoo. M 0 o, Poc, Qoc. Mo c , Pco. Qco. M c o, Pcc, Qcc and M cc are defined 
in Eq.(2.2.2), and where, 


Pcc = 

P 11 P 12 • * • P lp 
P 2 1 P 22 • • • P 2p 

, Pco = 

*10 

P 20 


_Ppl Pp2 ’ ’ ’ Ppp. 


. P pO. 

Poc = 

POI P02 • * ' Pop] 



Qcc = 

Q u Q 12 • • • Q ip 
Q 2 1 Q 22 ' ' • Q 2p 

• « m 

« * • 

> Qco = 

Q 10 

Q 20 


_Qpi Qp2 • • • Qpp. 


.Qpo. 


Qoc = [Qoi Qoa * • • Qop] 


Pij, Qij e R nixn j ( Poi, Qoi 6 R nxni , P i0 , Qio € R : 




Mij is given by: 


P 

My = E PikQkj, for i = 0,-.-, p, j = 0, •••, p 

k»0 


When the matrices P and Q satisfy Eqs.(3.3.19,20), they become, respectively, 
the observability and the controllability grammian of the closed loop system, 
where the inputs to the closed loop system are the process noise and the 
measurement noise and where the outputs are the controlled variables and the 
control inputs. The matrix M becomes the Hankel matrix of the closed loop 
system [Glo84, Fra87|. The eigenvalues of the matrix indicates the transmission 
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properties between the inputs and the outputs of the system. Hence, Eqs.(3.3.21- 
23) try to reduce, in some sense, the eigenvalues of M, either directly , 
Eq.(3 3.21), or indirectly by selecting the proper dynamics for the controller and 
the proper interaction between the controller and the plant. The architecture 
constraints reduce the freedom that one has to shape M. 


3.3.4 Second Order Necessary Conditions for Optimality 


The second order necessary conditions state that the matrix of second derivatives 
of the Lagrangian with respect to the free variables of the problem must form a 
positive matrix. This matrix, also known as the Hessian, is always a symmetric 
matrix. One can compute it by differentiating the first derivatives of Eqs.(3.3.6- 
10). The matrices P and Q can be seen as intermediate variables. If the closed 
loop dynamics are strictly stable, then the two Lyapunov equations of 
Eqs.(3.3.19,20) have unique solutions that yield P and Q as functions of G, A c 
and K. In order to obtain a Hessian of smaller size we will consider that the free 
variables of the problem are the vectors g, a* and k that are grouped in a vector 

i- 


*- 


<k 

9 . 
k 


( 3 . 3 . 24 ) 


the Hessian matrix is: 


l ££ “ £ L 6£j 1 1 < i <y n £ " V + n 9 + n *’ 


1 < j <n 


or, in partitioned form, using the partitioning of 


L « = 


L L L , 
(X c flc & c9 

L ga c L gg L gk 

L ka c L kg l kk ■* 


( 3 . 3 . 25 ) 
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Because P and Q have been eliminated, one must use the chain rule in the 

differentiation of L , L and L. in order to account for the fact that P and Q 
g (Lq k 

satisfy Eqs. (3.3. 19,20). L fl ., the derivative of L with respect to a \ , is given 

Eq.(3.3.15) by: 


l 0i = Trt^Vo 

L. , given by Eq.(3.3.6) is a matrix function of P and Q. Hence, the variation of 

Ac 

with respect to £ j is: 

1 ic<j = 1 i c F' P <j * 

where the product composition rule is defined in definition 3.2. Hence, from 
Eq.(3.3.15): 

(3 ' 326) 

Similarly, denoting by H the matrices G or K, by Lg, Lq or Lg, and by h the 
vectors g or k, the variation of Lg with respect to £j is: 


L H£j = L H^j + L HP’ P ^j +L Hq‘^j 
Eqs.(3.3.17,18) yield: 


Hi Hi “WHi 1 


(3.3.27) 


The matrices ? e and Q* are found by differentiating Eqs. (3. 3. 19,20) with 
sj sj 

respect to £j. P^. and Q^. satisfy: 

Ojj^ = A c i P^ + P^Aci + Ad^P + PA c i^ + Hci^ 

°fl«fl = Acl ^j + ^j AclX + + ^ kcl li + Vcl ^j 
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where: 



^n*n 

0 

n»n c 

-^n c *n 

eV 

^n»n 

BE ? i ' 

0 

n c »n 

0 

n c * n<r 

^n*n 

^n*n c 

_E*iC 

^n c *n c - 


$i = a i 


= 9\ 


£j — 


(3.3.28) 



^n«n 

0 

n c »n 


0 

n»n c 

G T R c E 5 i+E 5 i T R c G 


. £j - 9U 


otherwise, 


(3.3.29) 


v “<, = 


^n«n 

-^n c »n 


0 

n i He 

KV c E^i T +E^iV c K T J 


£j = *i, 0 fixfi otherwise. 

(3.3.30) 


Defining: 


W * p "« i 

and partitioning P^., and according to Eqs. (3.3.2) as. 


p «i = 


PwPk 

1 _ l 


[_P co P ccj 


■ Q t- = 


1 1 , 
Qoo Qoc 

i i 
Qco Qcc. 


■ M «i = 


Moo Moc 
Mco Mcc 


L Ac^> L G£j and L K^j are: 

L. a. = M C c 

A <*J t T ! 

L f A. = R c E 5 iQcd5(5i^j) + RcGQcc + B M 0c 

^ J i i l T 

L K a = PccE A iVc^(^i,^j) + PccKVc + M c0 C 


(3.331 ) 

(3.3.32) 

(3.3.33) 
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where £(hi,£j) = 1 if h\ = £j, 0 otherwise. 


Proposition 3.2: A solution to Problem 3.1 makes the cost stationary. It 

corresponds to a local minimum is the Hessian is positive. The condition is 
sufficient if the Hessian is not singular. 


Proof 

This result is a standard theorem that ensures that the cost can only increase 
when the stationary point is submitted to small perturbations, thus making such 
a point a minimum locally [Kir70]. 


3.4 THE FIXED ARCHITECTURE STATIC OUTPUT FEEDBACK 
PROBLEM 


3.4.1 Problem Statement 

The compensators that have been looked into so far are dynamic compensators 
whose transfer functions roll off at high frequency. Static Output Feedback on 
the other hand yields an all pass transfer function. Consider the n-dimensional 
LTI plant with m inputs and 1 noiseless outputs: 


X = AX + Bu + w 

y = CX 

where A 6 IR n n , B 6 IR n m , C € n , w 6 [R n white noise, covariance V. We look 
for a feedback law 

u = -Fy, F 6 R mxl 
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that minimizes the following quadratic cost: 

J = liraiE{X X RX + u X R c u} 
t-*® 1 

Because the control u is directly proportional to the output y, one cannot allow 
for white noise to corrupt the measurement: this would make the variance of the 
control infinite along with the value of the cost J. Colored noise however can be 
accommodated by incorporating the noise dynamics into the plant: the output of 
the augmented system becomes a noiseless signal as required. As in Section 
3.2.3, the cost can be written as: 

J = ^ Tr QR c i ( 3A1 ) 

where 

q = lim E{XX T } 

t *0D 

is the closed loop steady state covariance matrix that satisfies the filter Lyapunov 
equation: 

Vr = * ,ic * T * Vcl (3A2) 

and where 

A c i = A — BFC 

Vci = V 

R c i = R + C F R c FC. 

As in Section 3.2.3, one can define a Lagrangian for the problem in order to 
incorporate Eq.(3.4.2) and account for the dependence of Q on the feedback law. 
The Lagrangian is: 

L = \ Tr(QR c i + PVci + A c iQP + PQA c i X ) ( 3 - 4 - 3 ) 

It is possible to restrict the authority of the sensors and the actuators by insisting 
that only certain sensor-actuator pairings be retained in the feedback loop. 
Define Q as the set of all pairs (i,j) such that sensor i is connected to actuator j 
Fij will be nonzero if and only if (i,j) belongs to Q. As in Section 3.2.3, one can 
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define a basis for the subspace Sp of R®' 1 in which F must lie. Sp is spanned by 
the basis matrices E^i such that: 


e 4 = E? 1 ’* *=> Fij is free 

Denoting by £p = {E^i, e 4»* • • , E"ny}, F can be written in the form: 

F = £p*/ 

where / = = F* = [f u f 2 , • • • , / n ^] T 


3.4.2 Necessary Conditions for Optimality 

The stationary conditions are obtained using the differentiation rules of Section 


3.3.1. The variation of the Lagrangian is: 

bp = j (A c iQ + QA c i^ + V) (3.4.4) 

hq = j (A c i P + PA c i + R c i) (3.4.5) 

L F = R c FCqC T - B T PQC T ( 3 . 4 . 6 ) 

The first order optimality conditions become: 

°n, n = A c l( l + Q Ac l T + v (3.4.7) 

°n»n = AclTp + PAcl + Rcl (3.4.8) 


0 = TrE-f i T (R c FCqC T - B T PqC T ) , i = 1, • • • ,n^ 

= 7r®(R c FCqC T -B T PqC T )7ri T , ( i , j ) € ^ (3.4.9) 

P and Q can be eliminated from Eqs.(3.4.7,8). The steps for deriving the Hessian 
Iyy are similar to Eqs. (3. 3.24-33). In this case, P ^ and Qy. satisfy respectively 

°nxn = AclQ /i + Q /i AclT + Acl /i Q + QAcl /I 
°nxn = AclTp /i + P / Acl + Acl /I P + PAcl /i + Rcl /i 
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where 


k c if. = — BE^iC 

R cl , = C T F T RcEAc + c' Vi T R c FC 

/ i 

Lpy. is given by: 

L jj' = R c E^iCQC^ + R c FCQ jC — B (Py.Q + PQy.K 

and finally: 

Vj/i = TrE/ J TL F/, 

The second order necessary conditions for optimality require that Lj^be positive. 


3.5 EXAMPLES OF CONTROL ARCHITECTURE 

This section is aimed at motivating the use of a fixed architecture control 
structure. Indeed, the optimality conditions are rendered more complex by the 
introduction of constraints in the feedback loop and one can wonder what are the 
benefits one can expect from such compensators. The following subsections 
present some potentially useful control structures. 

3.5.1 Fixed Order Controller 

This constitutes the simplest constrained control structure: the number of poles 
in the feedback loop is limited to n c . There is a single processor connected to 
every sensor and every actuator. Such an architecture corresponds to the fixed 
order LQG problem. If n c is equal to n, one gets the usual LQG problem. For 
large scale systems, the order of the model can be quite high and there might be a 
limit to the order of the compensator one can realize. Instead of reducing the 
order of the plant to match that of the compensator, one can solve the reduced 
order LQG problem in order to get the best LQG compensator of order n c for the 
plant. The optimality conditions of Proposition 3.1 can be put in the classical 
form of two uncoupled Riccati equations when n c is equal to n, [Kwa72b], or can 
be transformed as an Optimal Projection Equation problem if n c is strictly less 
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than n [Hyl84], as it will be shown in Chapter 4. 


3.5.2 Decentralized Fixed Order Controller 

The control law is implemented on p separate processors, each of which is limited 
in the number of poles it can realize. Each processor receives information from 
its own set of sensors and control its own set of actuators. No sensor and no 
actuator can be shared by any two loops. The compensator is then a set of p 
totally independent loops. With no loss of generality, it can be assumed that the 
first 1 1 sensors are attributed to compensator 1, the next I 2 to compensator 2, etc., 
and that compensator 1 drives the first mi actuators, compensator 2 drives the 
next m 2 etc. G and K are then block diagonal: 


G = 


Gj 0 • • • 0 

0 G 2 • • • 0 


Gi 6 R mixni 


0 0 • • • G P J 


Kj 0 • • • 0 

0 K 2 • • • 0 


Ki 6 IR 


ni“li 


0 0 • • • K p 


The compensator transfer function T„ is^« then^ also block diagonal 


T_V v 
C * 


G !(sl— A i) _1 K 1 0 

0 G 2 (sI-A 2 )- i K2- 


0 

0 


0 0 • • •Gp(sI-Ap)‘ 1 K p 


Such a structure can be used for systems made of very weakly coupled 
subsystems: on an aircraft for example, the handling qualities and the engine 
operations, even though coupled, are very distinct subsystems that can be 
controlled separately. On a large structure, one might want to geographically 
distribute the computation as well as the information flow. If the structure of 
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the plant consists of various modules, it is conceivable that each module has its 
own set of sensors, actuators and computation capability and that, because of 
wiring and interface complexity, one desires to keep the control loops of each 
module independent. 


3 . 5.3 Overlapping Controller 

The purpose is still to limit the information flow in the feedback loop and to give 
the processors limited information and limited authority. Here, each processor 
has its own sensors and actuators but is allowed to receive information from the 
sensors of neighboring processors. G is therefore still block diagonal, but K has a 
tridiagonal block structure: 


G = 


Gu 0 0 0 

0 G 2 2 0 0 
0 0 G33 0 


0 

0 

0 


Gij 6 




K = 


'k u k 12 0 0 • 

K21 K22 K23 0 * 
0 K32 K33 K34* 


0 

0 

0 


Kij € » 


n i* lj 


The compensator transfer function T^ has the same tridiagonal structure as K 
inthat case: 

Tii( S ) = G n ( si — A i) l Kii 
Tii*i(s) = Gii( si — A i) 'Kii*! 

Tii-i(s) = Gii(sl— Ai) ‘‘Kii-i 

Such an architecture can also appear on a large flexible structure that possesses 
many distributed sensors and actuators. The dynamics of the structure at one 
point depend on the inertia and external forces occurring at that point as well as 
the dynamics of the neighboring points. Consequently, it makes sense to obtain 
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information about the local dynamics of neighboring elements in order to 
attenuate the propagation of vibrations in the structure. 


3.5.4 Hierarchic Controller 

One way to implement a hierarchic control scheme is to let one of the processors 
have more authority than the remaining ones. This means that one of the 
processor can receive information from all the sensors and that it will drive all 
the actuators. G and K are: 


GiO • 

0 G2* 


0 0 • 


0 Gip 
0 G2p 


Gp-iGp-ipJ 


K i 0 • • • 0 

0 K 2 • • • 0 


0 0 ---Kp., 

,K p i Kp2 Kpp.i 


Processor number p plays the role of an upper level or global controller. 
Assuming that this processor is of reduced order, and assuming that its dynamics 
are much slower than that of the processors i = 1, - • • , p— 1, the compensator 
transfer function Tq(s) will be approximately block diagonal at high frequency, 
as in the case of the decentralized architecture, corresponding to high bandwidth, 
local control; at low frequency, will be a full matrix with interconnection 
between every sensor and every actuator, corresponding to global, low bandwidth 
control. 
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3.5.5 Fixed Dynamics Controller and Frequency Weighted Cost 

Assume the dynamic of the controller is the realization of band-pass filters 
applied to the outputs of the sensors and that these filters have been designed 
before starting the optimization procedure. A c , and K are therefore fixed, and G 
is restricted to be: G = FG 0 , where Go is chosen such that the triplet ( G 0 , A c , 
K) realizes the transfer functions of the filters. F is an m * 1 matrix of free 
parameters. If one augments the plant with the dynamics of the various filters, 
the problem becomes a Fixed Architecture Static Output Feedback problem. 
Other design techniques used to obtain frequency domain results using the LQG 
methodology can be used here as well. Integrators can be used in order to 
remove steady state tracking error. The cost can be shaped as well [Gup80]. The 
procedure is to filter the variables of interest or filter the process noise to make it 
colored. The plant must then be augmented with the states of the filter. Any 
given fixed architecture LQG problem can then be solved using the modified 
plant. The frequency shaping of the cost has the same effect on the full order 
LQG problem as on any fixed architecture problem. 
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3.6 CONCLUSION 


First and second order optimality conditions for two types of H 2 Optimal Fixed 
Architecture Control problems have been derived in this chapter. The first type 
of problem is a constrained LQG problem which results in multiloop dynamic 
compensation. The loops are built around parallel processors which dynamically 
connect selected sets of sensors to selected sets of actuators. The second type of 
problem is a constrained LQR problem that yields a static output feedback 
compensator. The use of both types of controllers renders possible the design of 
compensators such as fixed order, decentralized, overlapping, hierarchic or fixed 
dynamics compensators. 


82 


INVESTIGATION OF THE 
PROPERTIES OF THE OPTIMALITY CONDITIONS 


4.1 INTRODUCTION 


The H 2 fixed architecture control problem being a generalization of the classical 
LQG problem, one would hope for some properties of the unconstrained problem 
to extend to the fixed architecture case. One well known property of the 
unconstrained LQG problem is the separation principle: its resolution separates 
into an optimal full state feedback and an optimal filtering problem. Two 
Riccati equations, the Control and the Filter Algebraic Riccati Equations (CARE 
and FARE) are solved to find the control gains and the filter gains. These 
equations do not appear immediately, however, when the unconstrained LQG 
problem is set as the optimization of the cost over the class of centralized full 
order compensators, which is a class of compensators that contains the overall 
optimal solution. The CARE and the FARE are hidden in the optimality 
conditions Eqs.(3.3. 19-23) that hold for this problem. One must, therefore, 
transform Eqs. (3.3. 19-23) in order to eliminate the matrices G, A c and K from 
the problem and perform some block transformations on the matrices P and Q, 
which are 2n-dimensional, in order to obtain two Riccati equations. Similarly, 
the Optimal Projection Equations (OPE) that hold in the case of the reduced 
order compensator problem, [Hyl84], are also hidden in Eqs. (3. 3. 19-23). The 
OPE show that the reduced order compensator problem consists of two coupled 
control and filtering problems where the coupling takes the form of an oblique 
projection (that is not necessarily orthogonal) [Hyl84]. The control gains, filter 
gains, and the compensator dynamics depend on the four n-dimensional 
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nonnegative symmetric matrices solutions to the OPE. 

The first part of the chapter will be devoted to transforming the 
optimality conditions derived in Chapter 3 in order to unveil the structure of the 
Fixed Architecture Control Problem. The structured optimality conditions 
become, in particular, the usual CARE and FARE when the compensator is 
centralized and full order, and they become the OPE in the case of the reduced 
order compensator problem. What happens, in that case, is that the control 
gains, the filter gains, and the compensator dynamics can be eliminated from the 
problem and can be expressed as functions of the matrices P and Q as well as the 
parameters of the problem. When the values of G, A c and K are substituted into 
the equations yielding P and Q, one obtains sets of equations which only depend 
on P and Q. These equations may be more complex, but they depend on a 
smaller number of variables. It will be shown in this chapter that G, A c and K 
can also be found as functions of P and Q, but that one cannot, however, obtain 
an analytic expression for G, A c and K as a function of P and Q, in the case of 
the fixed architecture control problem. Hence, one cannot derive equations 
yielding P and Q that involve P and Q only, and one must always resort to the 
use G, A c and K as intermediate variables. 

The remainder of the chapter focuses on the study of the properties of the 
optimality conditions in their original form, since the structured conditions do 
not bring any simplification. It will be shown that Eqs. (3.3. 19-23) do not define 
a well-posed problem. The optimality conditions define the compensator transfer 
function, but they do not select any specific realization for that transfer function. 
Hence, if ( G, A c , K) is a particular state space realization of the compensator 
transfer function that satisfies the optimality conditions, so will any realization 
obtained through a similarity transformation. The solution to the problem is a 
class of equivalence, where two triplets ( G, A c , K) are said to be equivalent if 
they realize the same transfer function. The most general problem is, therefore, 
singular. The singularity can be removed or reduced in a number of ways. All 
approaches consist of trying to constrain the realization of the compensator 
They are of very pratical importance since numerical methods converge faster 
when the solution is an isolated point in parameter space. 

The last part of the chapter is devoted to showing that the problem can 
have solutions which are saddle points. Such an occurrence is very important 
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since it shows that the problem is not convex and that the Eqs.(3.3.19-23) may 
have more than one solution. 

The chapter begins with mathematical preliminaries. They will focus on 
the matrix Lyapunov equation which plays a predominant role in the H 2 
problem. A theorem about existence and uniqueness of the solution to a linear 
system of matrix equations will also be proven. 


4.2 MATHEMATICAL PRELIMINARIES 


4.2.1 The Matrix Equation AX — XB = C 


Proposition 4.1: Given the matrices A 6 K n,n , B € R m,m , X, C 6 R nnn , the matrix 
equation 

AX - XB = C 

is a linear equation in X. It has a unique solution if and only if A and B have no 
common eigenvalues. If A and B share an eigenvalue X, and denoting by m a the 
multiplicity of X as a characteristic value of A, and mb the multiplicity of X as a 
characteristic value of B, the equation will admit no solution if there exists w € 
Ker(AI— A^) ma and v € Ker(AI— B) m ^ such that: w^Cv ^ 0. The equation has an 
infinite number of solutions otherwise. ■ 


Proof: The proof can be found in Gantmacher, Chapter VIII [Gan59]. If each 
eigenvalue has multiplicity 1, w is a left eigenvector for A and v is a right 
eigenvector for B. In the more general case, one has to consider a Jordan 
decomposition, and the multiplicity of the eigenvalue has to be taken into 
account. n 
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(4.2.1) 


Proposition 4.2: The Lyapunov equation: 

0„ = AX + XA T + V 

run 

respectively: 

0 nin = A T X + XA + R (4.2.2) 

where A, X, V, R € tR n has a unique solution if and only if A does not have any 
eigenvalue on the imaginary axis. IfW ( respectively R) is symmetric and positive 
semidejinite, and if( A, V l/ ' 2 ) is stabilizable, (respectively ( R^ 2 , A) is detectable ) 
the following statements are equivalent: 

i) A is asymptotically stable 

ii) X symmetric, and X > 0 a 

Proof: The uniqueness of the solution comes directly from Proposition 4.1 for B 
T 

= —A . The proof of the second part of the proposition can be found in [Kai80] 

pp 178-179. The present formulation is more general, however, since it does not 

insist on X being positive definite. Assume X is singular, and let v be a singular 

T 

vector of X. Premultiplying Eq.(4.2.1) by v and postmultiplying by v yields: 

0 = t/ T Vt/ 

V being positive semidefinite, this is is equivalent to: 

0 n = V^v (4.2.3) 

Postmultiplying Eq.(4.2.1) by v only, one gets: 

0 n = xa t », 

implying that the nullspace of X is invariant under A: there must be an 

eigenvector of A , w, associated with an eigenvalue A , which is in the nullspace 
of X. w satisfies Eq.(4.2.3), which implies that the corresponding mode is 
uncontrollable. The pair (AjV 1 / 2 ) being stabilizable, A is strictly negative. Even 
if X is only semidefinite, A is asymptotically stable. c 
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4.2.2 Solution to a Linear System of Matrix Equations 


Theorem 4.1: Let C, D, X, R be matrices in R“«* R m,n and 

respectively, C and D symmetric, positive semidefinite. Let E x = { E b E 2 , • • 
E p } be a family of independent matrices on R mni . Consider the system of 

equations: 

X = E x * x, x 6 R p 

TrEj T CXD = TrEj T R, j * 1, • • • , P ( 4 - 2 - 4 ) 

where * follows Definition 3.1, and E x defines the subspace where X lies. Such a 
system is a linear system. It has a unique solution if C and D are definite. It has 
an infinite number of solutions, otherwise, if: 

Ker(C) C Ker(R T ) 

Ker(D) C Ker(R) ( 4 - 2 - 5 ) 

■ 


Proof: The proof is deferred to Appendix A. 


4.2.3 Generalized Inverses 


Definition 4.1: Given X € R n,n , with the following singular value decomposition : 


X = U 


S 0 

m«r 

0 0 
r»m r »r 


where U, V € C nln , unitary, S G R m,m , diagonal, with strictly positive diagonal 
elements, r = n— m; Define Xt : 

lE-i 0. 


Xt = V 


m«r 

0 0 
nm rir 


rrH 


Xt is the Moore-Penrose generalized inverse of X [Cam79]. Xt satisfies the 
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following properties: 

xxtx = X 

(XXt) = (XXt) H 

(Xtx) = (XtX) B 
xtxxt = xt 

XtX is an orthogonal projector parallel to Ker(X), the nuUspace ofX. When X is 
symmetric, XXt = XtX. ■ 

The properties given in the definition can be obtained simply by inspection using 
the singular value decomposition. □ 

Definition 4.2: Consider X € R n,n , such that X and X 2 have the same range. X 
has then a Jordan decomposition of the following form: 

'Jfi •••() O' 

0 Jj # • • 0 0 

X = L • *. : L-\ 

• * • * 

0 0 ...J r 0 

0 0 •••0 0 . 

Jti 

where the Ji are nonsingular. Define X w as: 

■ Jf ‘0 ••• 0 O ' 

0 Ja ' 1 • * - 0 0 

X# = L j j L ' 1 

0 0 • ■ • J* 1 0 

_0 0 • • • 0 0 . 

X^ is the group inverse ofX. It satisfies: 

X = XX#X 
X# = X # XX# 

XX ^ is an oblique projection on the range of X and parallel to its nuUspace. 
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4.3 STRUCTURED OPTIMALITY CONDITIONS 


4.3.1 Elimina tin g G, K and A c from the Optimality Conditions 

The resolution of the full order LQG problem can be decomposed into two 
successive steps. The first one consists of solving two uncoupled Riccati 
equations which can be obtained by simplifying Eqs.(3.3. 19-20) and replacing the 
compensator gains by their expressions as functions of P and Q. The solutions to 
the Riccati equations can then be used to obtain the optimal gains. If one desires 
to generalize the procedure to the constrained problem, one must be able to find 
analytic expressions of G, A c and K as functions of P and Q. Sections 4.3.1. 1 and 
4.3.1.2 show how G, K and A c are defined, and in most cases uniquely, as 
functions of P, Q and the parameters of the problem. A preliminary derivation 
consists of partitioning of Eqs.(3.3.19-20). They become. 

0 = QooA^ + AQ oo + BGQco + QocG B + ^ 

n*n ' * 

0 _ = QocAc^ + AQoc + BGQcc + QooC^K 

n * n c m T T 

0 R xn = QcoA + A c Qco + KCQ oo + QccG B 

0 = QccA c T + A c q cc + KCQoc + QcoC T I T + KV C K T 

n c *n c 

0 = PooA + A^Poo + PocKC + C K Pco + B 

n*n 

0 = PocAc + A^Poc + PooBG + C^K^Pcc 

n«n c 

0 = P c oA + Ac^Pco + PccKC + G B Poo 

n c *n 

0 = Pec Ac + Ac^Pcc + PcoBG + G^B^Poc + 6 B C G 

n c *n c 


( 4 . 3 . 1 ) 

( 4 . 3 . 2 ) 

( 4 . 3 . 3 ) 

( 4 . 3 . 4 ) 

( 4 . 3 . 5 ) 

( 4 . 3 . 6 ) 

( 4 . 3 . 7 ) 

( 4 . 3 . 8 ) 
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4.3.1.1 Solving for G and K 

Proposition 4.3: The system of equations consisting of the architecture constraints 
and the optimality conditions for the control gain G, Eqs.(3.3.17): 

G = E^g, 

0 = TrE^(R c GQcc + B^Moc)> i — 1,* • *,n^ 

and the system of equations consisting of the architecture constraints and the 
optimality conditions for K, Eqs.(3.3.18): 

K = Ey+k, 

0 = TrE*i T (P cc KVc ♦ M c 0 C T ), i = 1,- • • ,n k 

always admit at least one solution. Given P and Q, it is always possible to find G 
and K that satisfy the optimality conditions of Eqs.(3.3.17,18) as well as the 
architecture constraints defined in Section 3. 3. 1.1. a 

Proof: The problems satisfied by G and K are similar to the one covered by 
Theorem 4.1. One must check that their right hand sides satisfy the rank 
conditions expressed by Eq.(4.2.5). The following lemma must be proven first: 


Lemma 4.1: The following statements hold as long as P an Q are nonnnegative: 

Ker(Pcc) is included in Ker(Poc)- 
Ker(Pcc) is included in Ker(G). 

Ker(Pcc) is the unobservable subspace of(G , A c ). 

Ker(Qcc) is included in Ker(Qoc)- 
Ker(Q C c) is included in Ker(K ). 

Ker(Qcc) is the uncontrollable subspace of( A c , K). 


Proof: Let v 6 Ker(P cc ): P cc v = 0 . Consider the following vector X: 

lie 


X = 


-p o c v 

av 


, a € R 


T T 

P being positive, X PX is always nonnegative. Developing X PX: 

X^PX = v T P 0c T PooPocV - 2 qv T P 0c ^PocV 


The expression is positive for all a if and only if Po c v = 0 n . Thus v € Ker(P Cc ) 
and Ker(Pcc) C Ker(P 0c )- 
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T 

Pre and postmultiply now Eq.(4.3.8) by v and v. Because both P cc v = 

T T 

One and Pocv = 0 n , we get that v G RcGv = 0. Rc being positive definite, Gv = 

0 m and v 6 Ker(G): hence, Ker(P cc ) C Ker(G). 

Postmultiply now Eq.(4.3.8) by v. Since Gv = 0 , P C cV = 0 n c, and Pocv = 

0 n , this implies that P cc A c v = 0 nc : Ker(P cc ) is invariant under A c . Ker(P cc ) is 

therefore an invariant subspace of A c , and every vector in this subspace satisfies 

Gv = 0 m . Thus Ker(Pcc) is included in the unobservable subspace of the pair 

( G, A c ). Similarly, consider v such that A c v = Av and Gv = 0 m . Pre and 

postmultiplying Eq.(4.3.8) by v^ and v yields 2Av^P cc v = 0. If A # 0, P cc being 

positive, P cc v = 0 n c and the unobservable space of ( G, A c ) is included in 

Ker(Pcc). If A = 0, post multiplying Eq.(4.3.6) and Eq.(4.3.8) by v yields: 

T T T 

0 n = A P oc^ + C K Pcc^ 

0nc = G B P ocV + Ac P cc^ 

These last two equalities cam be written more succintly as: 

0 lifl = v T [P c0 P cc] Aci 

Ad being assumed strictly stable, this implies that P C cV = 0 n c and Pocv = 0 n : 
Ker(Pcc) is the unobservable space of (G, A c ). The rest of the lemma is obtained 
by duality. This ends the proof of Lemma 4.1. □ 

Checking Eq.(4.2.5) on the two systems is now obvious once Mq c and M c o have 
been developed according to Eqs.(3.3.2). This ends the proof of Proposition 4.3. 

□ 


4.3.1.2 Solving for Ar 

A c does not appear explicitly in the optimality conditions Eq.(3.3.21). A system 
of equations similar to that of Theorem 4.1 can however be obtained. The 
combination Eq.(4.3.7)Qoc + Eq.(4.3.8)Q C c yields: 

0 = PccAcQcc + PcqAQoc + PccKCQoc + PcoBGQcc + 

nc*n c 

+ Ac (PcoQoc + PccQcc) + 

+ G^(R c GQcc + B^(PooQoc + PocQcc)) 
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or, using Eq.(3.3.2) and Eq.(3.3.9): 


0 = PccAcQcc + PcoAQoc + PccKCQoc + PcoBGQcc + 

lie* «c 

+ A^L Ac + G T L 6 (4.3.9) 

Similarly, the combination P c oEq.(4.3.2) + P cc Eq.(4.3.4) yields: 

^n c «n c = ^ cc l c ^ cc + PcoAQoc + PccKCQoc + PcoBGQcc + 

+ L a 4 + Lj T K (4.3.10) 


A c being block diagonal, it can be written as: 

Ac = ^ H x A iU i 

i*l 

where Hi is defined in Section 3.2.3. Similarly, G and K can be written as: 

P 

G = E E 7r®^GijIIj 

j=l i€«j 1 
P 

K = E E IIi T Kij7ri 

i=lj€^i J 


Hi and i satisfy the following properties: 
= 0„ „ if i # j, 

1 1 ni*nj r J ’ 


= I 


Hi 


X k 7 i* = 0 

i j 

= 1 


if i = j. 
if i # j, 
if i = j, 


(4.3.11) 


Using the expanded forms of A c , G and K, and using the optimality conditions of 
Eqs. (3. 3.21-23), one obtains the following expression by pre and postmultiplying 
Eq.(4.3.9) by Hi and Hi T : 

^ni»ni = fli(^ cc AcQcc + PcoBGQcc + QccKCPoc)Hi , i = !,• • *,p 
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or equivalently: 

TrE fl j PccAcQcc = ~ TrE j (PcoAQoc + PccKCQoc + PcoBGQcc) 

j=l,-.-,n a (4.3.12) 

The same system is obtained by pre and postmnltiplying Eq.(4.3.10) by Ili and 
T 

Hi . This system is similar to that of Theorem 4.1 and will produce A c . 


Proposition 4.4: The system of equations consisting of the architecture constraints 
and the modified optimality conditions for k c : 

A c = E k *ac, 

TrE a i T (P cc A c Q cc ) = -TrE a i T (PcoAQoc + P c oBGq cc ♦ PccKCQoc), i = 1,- • n fl 

always admits at least one solution. Given P, and Q, G and K can be computed 
(Proposition 4.3), and, consequently, A c can always be determined. B 

Proof: the proof is exactly similar to that of Proposition 4.3. Lemma 4.1 

guarantees that the rank conditions are met. When the compensator is 
uncontrollable or unobservable, the dynamics of the corresponding mode is 
arbitrary. Its choice must correspond to a stable mode if one wants the overall 
closed loop system to be stable. 

o 
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4.3.2 Structured Optimality Conditions 


Proposition 4.5: - The following matrix equations hold if A c i is asymptotically 

stable: 


P 0c = P OcP cctP cc 

(4.3.13) 

PcO = PccPcctPcO 

(4.3.14) 

Qoc = QocQcc^Qcc 

(4.3.15) 

QcO — QccQcc^QcO 

(4.3.16) 


Proof: From the properties of the generalized inverse seen above, we know that 
P cc tPcc is an orthogonal projection parallel to Ker(P cc ). Eq(4.3.13) is equivalent 
to showing that the nullspace of P C c is included in that of P 0 c- This result 
follows from Lemma 4.1. Similarly, Eq.(4.3.15) follows from lemma 4.1 and 
Eqs.(4.3.14,16) are just transposed forms of Eqs.(4.3.13,15). o 


Theorem 4.2: Problem 3.1 has a solution if there exists P, Q, P, Q € IR n,n , 
symmetric positive, P cc and Q cc € K nclnc , symmetric positive, as well as $ and 
r € R n *n c and G, A c and K such that: 

°n«n = AQ+qA T + V-q!:q + ($KVc-qC T )V c - 1 ($KV c -l|C T ) T (4.3.17) 

°n„ n = A T P+PA+R-PEP+ ( rGR c — PB ) Rc 1 ( rG T R c -PB ) T (4.3.18) 

°mn = Aq+qA T + $q C cG T B T +BGq cc $ T ^qrq-($KVc-qc T )Vc 1 (^KVc-qc T ) T 

(4.3.19) 

°n»n = A T P>PA+rPccKC + C T K T Pc C r T >PEP-(rG T R c -PB)R c - 1 (rG T Rc-PB) T 

(4.3.20) 
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^n c *n c 

nc*n c 

0 

ni*ni 


0 


1 s n i 


0 


ni* 


1 


ni*ni 


= (A c+ KC$)q cc +qcc(Ac^C$) T +KVcK T 
= (A c +r T BG) T Pcc+Pcc(Ac+r T BG)+G T a c G 


= n iP cc ( i n + r^^)qcciii 

n c 


i = !,••*, p 


= TT® 

j 


- niPcc 


r c g + b t |p$ + rPcc(i nc +r T $)] ]q cc ni T , j e u it 

i — 1»* • *»P 

(i n< + r T $)q cc <* T + r T q]c T ]irj T , j € ft 

i = 1, — , p 


KV C + 


= niP cc (Ac + r T A$ + t t bg + KC$)q cc ni T , 


i = i, — ,P 


(4.3.21) 

(4.3.22) 

(4.3.23) 

(4.3.24) 

(4.3.25) 

(4.3.26) 


Proof: the proof is a matter of algebra. Define the following matrices, 


P = Poo-PocPcctPco (4.3.27) 

Q = Qoo — QocQcc^Qco (4.3.28) 

P = PocPcctPco (4.3.29) 

Q = QocQcctQco (4.3.30) 

$ = QocQcct (4.3.31) 

T = PocPcct (4.3.32) 

E = BR^B T (4.3.33) 

E = C T V c m C (4.3.34) 


Eq. (4.3.17) = Eq.(4.3.1)-Eq.(4.3.2)q cc tq c o - qo c q cc tEq. (4.3.3), as well as 
using Eq. (4.3.4) to eliminate A c and Proposition 4.5 to regroup terms. 

Eq. (4.3.18) = Eq.(4.3.5)-Eq.(4.3.6)P C c t Pco - PocPcc t Eq-(4.3.7), as well as 
using Eq. (4.3.8) to eliminate A c and Proposition 4.5 to regroup terms. 

Eq. (4.3.19) = Eq. (4.3.1) - Eq. (4.3. 17) . 

Eq. (4.3.20) =Eq. (4.3.5) - Eq. (4.3.18) . 

Eq. (4.3.21,22) = Eq. (4. 3. 4, 8) . 

Eq. (4.3.23) = Eq.(3.3.21). 

Eq. (4.3.24,25) = Eq. (3.3.22,23) . 

Eq. (4.3.26) = Eq. (4.3.12). ° 
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The full order LQG problem and the reduced order LQG problem are both 
specific cases of the fixed architecture LQG problem, and both satisfy 
Eqs.(4.3. 17-26). The optimality conditions are not so complicated in those cases: 
we shall now show how the increasing specificity of the architecture increases the 
coupling between the different optimality conditions. 

4.3.2. 1 Full Order LQG 

The architecture parameters for the full order compensator problem are: p = 1, 
n c = n, Hi = I n . Eq.(4.3.23) becomes: 

i» =-r T $ 

Eq.(4.3.24,25) become: 

G = -R c ' l B T P$ 

k = -rVvc* 1 

This implies that the two positive terms in Eqs. (4.3. 17,18) are zero and the two 
Riccati equations decouple. P and Q satisfy: 

H * «i T * v - DEq 

0. . = t T P ♦ Pi + E - PSP 
nin 

Eq.(4.3.26) becomes: 

A c = — T T (A - BG — KC)$ 

The solution is the classic LQG solution with the two independent Control and 

T 

Filter Riccati equations. The choice of $ and T such that T <5 = -I n correspond 
to choosing different state space realization for the controller. Eqs. (4.3. 21, 22) 
allow one to compute the optimal cost by producing Q C c and P cc . 


4.3.2.2 Optimal Projection Equation 
The OPE corresponds to p = 1 and n c < n. 

Eq.(4.3.23) becomes: 

in = -r T $ 

C 

As shown in [Hyl84], Eq.(4.3.23) implies that the matrix r = € D? n ‘ n is 

idempotent: r 2 = r. ris therefore a projection operator. T and $ being two n*n, 
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matrices, the rank of r is at most n c . Eqs.(4.3.24,25) become: 

G = — RcVp* 

K = -rVvc' 1 

Defining 

T ^ = In T 

= In * ir T 

it follows that: 

$Kv c -qc T = -r x qc T 

TGic-PB =-t x T PB 

The modified Riccati equations Eqs.(4.3.17,18) and the Lyapunov equations 


Eqs.( 4 . 3 . 19 , 20 ) become: 

0 =Aq + QA T + V-qi:Q + r QUqr T ( 4 . 3 . 35 ) 

n*n J- 

0 = A T P + PA + R - PEP + r T PEPt ( 4 . 3 . 36 ) 

nm J- 1 

0 nxn = (A-PE)q + q(A-PE) T + qsq - rjuqr 1 (4.3.37) 

0 = (A-Eq) T P + P(A-rq) + PEP - r T PEPt ( 4 . 3 . 38 ) 

RlQ v 7 J- x 


The projection operator appears when combining Eq.(4.3.23) and Eqs.(4.3.29,30). 
From Eq.(4.3.23) the projection is: 

T — — QocQcc^PcctPcO 


The product QP is, Eqs.(4.3.29,30): 

QP = QocQcct(QcoPoc)PcctPco 

Thus, r can be found using the group inverse of QP , Definition 4.2, 

r=qP(qP)# (4.3.39) 

By reducing the order of the compensator, one has introduced some coupling 
between the control and the filter problem. The separation principle does not 
hold anymore and one has to find the optimal oblique projection that couples 
control and filtering. Both problems have to be solved simultaneously. The 
dynamics of the compensator is simply obtained using Eq.(4.3.26). It yields 
simply: 

A c = -r T (A - EP - Q£)$ (4.3.40) 
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4. 3.2.3 The Decentralized Fixed Order Control 

We consider here the Decentralized Control Problem where K and G are block 
diagonal as defined in Section 3.5.3. This is the simplest form of constrained 
architecture in that G and K are block diagonal and can be computed from 
Eqs. (4.3.24,25) using simple matrix algebra. Since the control consists of 
independent loops, it can be shown, [Ber87b], that one can define p optimal 
reduced order problems and p projection operators. Each subcontroller satisfying 
the optimality conditions, it is optimal for the system composed of the original 
plant with the remaining control subcontrollers closed. Each independent 
compensator satisfies therefore the Optimal Projection Equations Eqs.(4.3.35-39) 
for the modified plant. Each subcontroller cannot be designed individually since 
the system on which the local loop is closed is the original plant with the 
remaining subcontrollers closed. There is, therefore, some loop coupling 
introduced in the problem. More precisely, Eq.(4.3.23) becomes: 

0 n .„ n . = EiPcc(In ^)QccIIi^, i=l, - • *,p 

II II c 


The set of equations is not enough to completely determine T and $. The 
optimal gains G and K are block diagonal Eqs.(3.5.1,2), G = blockdiag(Gi, 
G 2 ,---,G P ), Gi € [R mixni , and K = blockdiag(K lt K 2 ,---,K P ), Ki 6 
Eqs. (4. 3.24,25) can be regrouped and written in matrix form as: 


Gi =-R i * 1 Bi T |^p$ ♦ rp cc (in c + r T *))]qccni T qif l 

[r T q + (i„ c + r^q^CiV 1 


Ki =-Pii-'niP 


Gi and Ki can be eliminated in that case, but an overlapping decomposition of 
the sensors and actuators among processors result in the more general systems 
described by Eqs. (4. 3. 24, 25) whose solutions require the use of Theorem 4.1. The 
dynamics of the compensator A c is found solving Eq.(4.3.26) which cannot be 
simplified. All the blocks must be determined at once (Proposition 4.4) unlike in 
the centralized case which resulted in the simple expression of Eq.(4.3.40). Two 
mechanisms couple the problem. The first form of coupling appears between the 
modified filter and control Riccati equations as ($KV c -qC^')Vc 1 (^kV c -qC^)^ and 
( rG T R c -PB ) Rc 1 ( TG T R c -PB ) T in Eqs.(4.3. 17,18). The second form of coupling 
appears as loop coupling in the form of P C c(Inc + r $)Qcc which arises in 
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Eqs.(4.3.24,25). G and K can be solved as functions of P and Q and eliminated, 
but this will not result in a simple matrix expression. P cc and Q cc do not 
disappear as the in previous cases. It indicates the coordinations between the 
subcontrollers. A c is required to solve for P cc and Q C c- The structured form of 
the optimality conditions does not give rise to a decomposition of the optimality 
conditions as it was the case for the full order and for the reduced order LQG 
problem. One must solve simultaneously two modified Riccati equations coupled 
through four Lyapunov equations, and the control parameters must be found as 
well. 


4.4 PROBLEM SINGULARITY 
4.4.1 Cost Invariance 

The necessary conditions for optimality as they appear in Eqs.(3.3.19-23) form a 
singular system of equations. In order to prove that fact, it will be shown that 
certain transformations on the control variables leave the cost unchanged. 


Theorem 4.3: Let N 6 R nc * nc be block diagonal 

N = blockdiag( Ni, N 2 ,* • •, N p ), 
where Ni 6 R ni * ni , invertible. Also define N as: 

N = blockdiag( I n , N) 

The Lagrangian L is invariant under the transformation: 


p = 

n t pn 

Q = 

N-iqr' 

G = 

GN 

A c = 

N^AcN 

K = 

N _1 K 
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Proof: Ad and Rd and V c i respectively become: 

A c i = N^AciN 
V c i = N^VciN * 1 
R c i = N t R c iN 

Twice the Lagrangian of Eq.(3.2.6) becomes: 

2 L( GN, N-‘A C N, N'l, N T PN, N**QN * T ) = 

Tr[(N- , qN* T )(N T R c iN) + (N T PN) (N 1 V c iN- t )-k 

+ (N^AdN) (N'^N* 1 ) (N t PN) + (N T PN)(r l Qp)(N T A c i T N J )] 

= TrtN^qRciN) + Tr(N T PV c iN* T ) + 

♦ Tr(N* l A c iqPN) ♦ Tr(N T A c i T Pqr T ) 

= Tr(NN' l qR c i) + Tr(PV c iN‘ T N T ) + 

♦ Tr(NN' 1 A c iqP) ♦ Tr(A c i T Pqr T N T ) 

= Tr(qR c i + PV c i + A c iqp + PqA c i T ) 

= 2L(G, A c , I, P, Q) o 


The transformation N consists of changing the internal realization of each 
subcontroller. Theorem 4.3 shows that the cost is invariant under such a 
transformation. Consider now that each N \ has the form: 

Ni(e) = I ♦ eli, 

where Mi e R ni * ni is any n^ni matrix. For e sufficiently small Ni is invertible. 
The differential of Ni with respect to £ is Ni = Mi. Hence, N = blockdiag(M 1) 

w S 

M 2 , • • • ,M P ) and N £ = blockdiag(O n)<n ,N £ ). One can write: 

l(£) =l(GN(£),lt(£) -'AcN(f) , N(£) 1 K,fi(e) T Pi»{£) ,K(e) -*qN(e) - T ) 


Consider further that P, Q, G, A Cl K satisfy the two Lyapunov equations 
Eqs.(3.3.19,20). Then, P(£), Q(e), G(£), A c (£), K(e) satisfy Eqs.(3.3.19,20) for 


all £. Indeed, pre and postmultiplying Eq.(3.3.19) by N 


= N T Aci T (N J N T )PN - N T P(NN*‘)A c iN + N T R c iN 
= A c l(£) T P(£) + P(£)A c l(£) + Rcl(e)- 


Hence P(£) satisfies Eq.(3.3.19) for all e. The proof for Q(e) is similar. 

Theorem 4.3 states that L(£) is constant. Expanding L(£) to second order 
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and using the matrix differentiation rules, one gets: 


0 = e j^Tr (LqG £ ) + Tr(Lj c Ac £ ) + Tr ( L K K e )] + 

♦ £2 [Tr(Lj6 ££ ) + Tr(Lj c A C££ ) + Tr(LjK ££ ) ♦ ^L^ £ 


+ 0(£3) 


where £ is defined by Eq.(3.3.24) and where of Eq.(3.3.25) is the Hessian of 
the Lagrangian as calculated in Sect.3.3.4. $ £ is the partial derivative of £ with 
respect to e. The Hessian calculated in Section 3.3.4 is computed assuming that 
P and Q vary as functions of G, A c and K such that Eqs.(3.3. 19,20) are always 
satisfied. Such is the case for P(c) and Q(e), which is the reason why is 
used. Expanding to second order, N and N' 1 become 
N = I + eN £ + 0(e*) 

N* 1 = I — eN £ + e 2 N| + 0(e 3 ) 

Expanding G(e), A c (e) and K(e) next, one obtains the following partial 
derivatives: 


g £ = gn £ 

A Cg = A c N £ -N £ A c 

K = -N K • (4-4.1) 

£ £ 

G =0 
ee m*n c 

■ -W * »l*« 

K ££ = N|K 

G(e), A c (e) and K(e) still satisfy the architecture constraints. It follows that the 

matrices G , A c and K are in the matrix subspaces defined by the architecture 
£ £ £ 

and one c an define a vector £ £ using the notation of Definition 3.1 as: 




G £* B G 

kc £* E k c 

■ l £*h 


( 4 - 4 . 2 ) 


Hence, to second order: 
0 = £ 


TrL A ^(A c N £ -N £ A c ) + TrL G T GN £ - TrL K T N £ K 
+ £ 2 flrl ( N g A c — N £ A c N £ ) + TrL K T N|K + 

+ 0(e 3 ) 


( 4 . 4 . 3 ' 
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where N is any block diagonal n c * n c matrix of the form: N = 2 ) H^Nilli. In 

£ is 1 

particular, this implies that the e term must be zero, or: 

0 ni«ni = ni ( L Ac Ac-AcL Al + L G T(I _Kl K T ] niT ’ i=1 >*">P (4.4.4) 

This actually corresponds to the restriction of the difference Eq.(4.3.9) - 
Eq.(4.3.10) to its i th diagonal block. Once Lp and Lq are zero, Lq, and 
satisfy Eq.(4.4.2) which regroups n^ + n 2 2 + • • • + n p * equations: the necessary 
conditions Eqs.(3.3.19-23) are therefore singular. 


4.4.2 Minimal Set of Variables, Minimal Set of Equations 

Singular problems are very difficult to solve numerically. One would like to 
reduce the number of variables as well as the number of optimality conditions 
such that the new system of equations has isolated solutions. The transformation 
should yield the remaining control parameters as a function of the reduced set of 
variables and the optimality conditions not retained in the reduced problem 
should be satisfied as well. 

P and Q should be eliminated since they regroup a large number of 
variables — n(fl+l) variables when one enforces the symmetry of P and Q — and 
since they satisfy Lyapunov equations for which reliable numerical methods are 
available. One must try to constrain G, A c and K and eliminate some of the 
conditions in Eqs. (3.3.21-23). Eq.(4.4.4) will then be used to check that all 

optimality conditions are met. The following subsections present three different 
ways of choosing the variables and the optimality conditions to reduce the 
singularity of the original formulation. 


102 


4.4.2. 1 MIMO Contro ller Canonical Form 


Proposition 4.6: The following subset of the optimality conditions 
0.^ = A c i^P + PA c i + R c i 

^fi*n = Ac ^ + + 

0 » = Mii 7r^ iT , 

0, = 7r“LpIIi T , j 6 ffi 

l«ni j Cr 


is equivalent to the full set of conditions Eqs.(3.3.19-23) provided that each 
subcontroller is in Controller Canonical F orm, 

A c = blockdiag(Ai, A 2 ,- • *, A p ), 


Ai — 


11, AueR 11 ^ 1 , A t2 € R 11 * 11 , ri 

- SViiJ 


ni-ii 


number of sensors associated with subcontroUer i, 


t V 

which is 


: x 11 ^, ni by 1 column vector with all elements zero except the j th 

1 k- = filter gain of the j th sensor associated with the i th subcontroller. 
l j 


Proof: before the main proof is derived, the structure of the i th subcontroiler will 
be detailed. Regrouping the sensor signals received by the i th subcontroUer into a 
li dimensional vector yi and, similarly, regrouping the corresponding filter gains 
Kij into the matrix Ki, the dynamics of the compensator become: 

Xi = AiXi + Kiyi, Ki € R nixli , yi € IR 11 * 1 

The structure of the compensator retained in Proposition 4.6 corresponds to the 
MIMO ControUer Canonical Form, [Kai80], for the pair (Ai, Ki). Ki and Ai 
become: 


[11 

li A . — 

[An A 12] 

.0 J 

ri > * ! 

Li 0 J 


li ri li 


where I and 0 are the identity and null matrix of suitable dimension. The 
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necessary conditions retained for the problem are: 

Eqs.(3.3.19,20), 

Eqs.(3.3.22), complete set 
The last li columns of Eq.(3.3.21) 

We must show that: 

The ni-li first columns of Eq.(3.3.21) are satisfied 
Eq.(3.3.23) is satisfied 
Expanding Eq.(4.4.4), 

°ni*ni = _ + ni^ni 1, - niKL K T ni T (4.4.5) 

Since Eq.(3.3.22) is entirely satisfied and since G satisfies the architecture 

T T 

constraints the term H^GHi drops out. The last li columns of Eq.(3.3.21) 
being satisfied, Mu is: 


Mu = [M 0 n ,J,M£R ni * r i 


Regrouping the L K .. in a matrix L R € R ni><li like the Ky were regrouped in Ky 
T T ^ 1 T 

the term H iKL^U j becomes simply K jL^ : this follows from the fact that terms 
involving elements of Lj^ not associated with sensors used by loop i drop out 
since they get multiplied by zero entries of K. Expanding Eq.(4.4.5) in block 
form: 


0 


ni*ni 




A 12 



r l T 
hi 


ri*ni 



n T *i 1 


r*n« Tl 


ri 1 


a 

X 

*r4 

•H 

O 

1 


» T 


0 

L ri*ni 


(4.4.6) 


Assume li > ri. Then, the last ri rows of Eq.(4.4.6) directly yield M = 0 
Looking back at Eq.(4.4.6), one gets that L v = 0 , . 

If li < ri, then define di = ri — li and partition M as M = [M[ M 2 ], Mi € 
jrHi*1i, 6 <j>he j agt r . rowg 0 p gq. (4.4.6) become: 
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(4.4.7) 


M 2 T Ai 


r«, T i 

O-i „ 

— 

M 2 T 

. 1 i * n i, 




Notice that the two matrices in Eq.(4.4.7) do not share the same block 
partitioning: the first one has a di*ni and a li*ni block, the second matrix has a 
li*ni and a di*ni block. If li > di, then M 2 is zero. When Ii < di, M 2 has the 
form: 

M 2 = [m, m 2 - • -mj 0 n . Kli ], j = di-h, m k 6 R ni , column vector. 

T 

The h+l th row of Eq.(4.4.7), counted from the bottom, is simply mj = 0 1-n .. 
Hence, M 2 becomes: 

M 2 = [mi m 2 - • -mj-i 0 ni><l . +1 ]. 

Repeating the process, one can show that M 2 is zero. Consequently Mi is zero, 
and using Eq.(4.4.6), L *i is zero. D 

Subcontroller i being in MIMO Controller Canonical Form, n^ parameters 
are fixed: they correspond to the nt-4| last rows of the matrix Ai as well as all 
the entries of Ki. Similarly, the number of equations have been reduced: 
Eq.(3.3.23) has been completely relaxed and Eq.(3.3.21) has been reduced. These 
equations are, however, satisfied as soon as the remaining necessary conditions 
are met. Notice, however, that, whereas the last li columns of Mu are set to 
zero, some of the first columns of Mu are given as linear combinations of the last 
columns, as seen in the proof. The coefficients of the linear combinations are 
elements of the matrix Ai. The level of accuracy in setting the first columns of 
Mii to zero will, thus, correspond to the level of accuracy to which the last 
columns are set to zero, multiplied by a gain which is of the order of the 
maximum element of Ai. The level of accuracy at which l k is set to zero will 
also be an amplified version of the accuracy imposed on the last columns of Mii 
Hence, the values of Ai will be very influential in controlling the overall 
numerical accuracy of the solution using the MIMO Controller Canonical Form 
A second shortcoming, but less critical, is that it is not possible to accommodate 
loops with more sensors than internal states. Indeed, if they are more sensors 
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than they are internal states in the compensator, the matrix Ki will have more 
columns than rows and it will not be possible to put it in the canonical form 
specified in Proposition 4.6. 


4.4.2.2 MIMO Observer Canonical Form 


Proposition 4.7: The following subset of the optimality conditions 
= A c i P + PA c i + R c i 


— A c iQ + QA c i + V cl 
°ni»l = n i L K’ I f' 


j = ni— mi+l,» • • ,ni 
j€7i 


is equivalent to the full set of conditions Eqs. (3.3. 19-23) provided that each 
subcontroller is in Observer Canonical Form, 

A c = blockdiag(Ai, A 2 ,- • A p ), 

I. 


a , _ [An 
Ai " |Aji 


0 ri 
mi*ri J 


, A u 6 R rixmi , A 21 € n = ni-mi 


mi as number of actuators associated with subcontroller i, 

Gj.= ’fj 1 , 1 by ni row vector with all elements zero except the j th which is 1, 
Gj = control gain of the j £ h actuator associated with the i 1 * 1 subcontroller. 


Proof: the proof is the dual of the proof of Proposition 4.6. If we regroup all the 
actuator gains in one matrix Gi, then (Gi, Ai) is in MIMO Observer Canonical 
Form: 


Gi = [I 0] mi, Ai = 

mi r j 


An I 
A 2 i 0 
mi r j 


r i 

mi 


Eq.(3.3.21) is only partially enforced. Mu has the form: 


Mn = 


'M, M 2 ' 
0 0 


ni-mi 

mi 


Again, ni 2 parameters and ni 2 equations have been eliminated. The parameters 
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are the n.i— mi last columns of Ai and all the entries of Gi, and the equations are 
the first nt— mi rows of Eq.(3.3.21) and the entire set of Eq.(3.3.22). 

The shortcomings of the Observer Canonical Form are similar, or dual, to 
those of the Controller Canonical Form. The main one is the sensitivity of the 
accuracy which cannot be controlled, and the second one is the fact that one 
cannot have subcontrollers with more actuators than internal states. 


4.4.2.3 Modal Form 


Proposition 4.8: The following subset of the optimality conditions 
0. - = A c i P + P A c i + R c i 

11* II 

®fi*n = A c iQ + QA c i^ + V c i 

® W ’f'G 11 * j £ '* 

0 ni»l = n ' L K Ir f' J 6 y> 

0 = Mi^k^ka), k 2 even, ki= kj-l, k 2 , 

0 = Mii(m,ni) if ni is odd 


is equivalent to the full set of conditions Eqs.(3.3.19-23) provided that each 
subcontroller is in " real modal form": 

Ai = blockdiag(A i 1 , A^,- • ^A^, 

Aij € R 2 * 2 , ai r *i e IR ifni odd, 



a 4 j i a*j2 

1 0 


Proof: Eqs.(3. 3. 19,20,22,23) are all satisfied. A c is almost in modal form: it is in 
real modal form if each 2*2 blocks have complex conjugate eigenvalues. Such a 
representation will be called the "real modal form" of the compensator. Each Ai 
has the form: 
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0 

0 


0 

0 


a 4 ii a 1 !! 

1 0 


Ai — 


0 

0 


0 

0 


0 0 
0 0 

a x 2i a* 22 
1 0 


0 

0 0 
0 0 


0 

0 


0 0 0 0 
0 0 0 0 

0 0 0 0 


a*ri a^rjl 0 

. 1 0 J 0 

0 0 a* r »i. 


Repeating the partitioning of Ai on Mii, one gets 2*2 blocks along with 2*1, 1*2, 
and a 1*1 block if n\ is odd: 


rxi, 

X 1 2 • • • 

Xir 

X ir+l 

X 21 

X 22 * * • 

X 2 r 

X 2 r*l 

Xrl 

Xr2 * * • 

x rr 

X rr *i 

.Xr+U 

x r ♦ 12 * • • 

Xr ♦!! 

Xr 


Expanding Eq. (4.4.5) in block form, the off-diagonal block equations become: 

0 = X k j A* k — AijX kj T , (4.4.8) 

where 0 is 2*2, 2*1 or 1*2 depending on the block being considered. Ass um ing 
that no two blocks Aij and A* k have the same eigenvalues, Proposition 4.1 
implies that X k j = 0. Looking now at a diagonal block element, the conditions 


satisfied by Mu state that if X kk = 


, then x 12 = 0, x 22 = 0. If k = r+1, 


Xu x i2 
_Xj, x 22 . 

they state that X kk = 0. The diagonal block of Eq.(4.4.5) becomes: 


0 = X kk T Ai k - Ai k X kk X 


If k = r+1, X kk = 0. For i ^ r+1: 


'0 

o' 


*11X21' 

ai2 a 22 

0 

0. 


. 0 0, 

_ 1 0 _ 


an a 22 
1 0 


*ii x 21 ' 

. 0 o. 


Looking at the last row immediately yields x u = 0 and x 2t = 0. Hence, as long 
as no two block Ai and Aj share a common eigenvalue, the matrix Mh is 
identically zero. All the optimality conditions are, therefore, satisfied. 
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The variables describing Ai correspond to the ones used in [Ly85]. Their 
number is ni. The set of variables is not minimal: it is indeed possible to scale G 
and K without modifying the cost or changing the structure of A c . One must fix 
the scaling in order to have a unique modal realization. This operation does not 
lead to a simple elimination of some elements in G and K and it is not useful at 
this stage to go further. The modal description reduces the number of degrees of 
freedom that exist to change the realization of one subcontroller from n^, for the 
ith subcontroller, down to ni. 

Eq.(4.4.8) is obtained from Eq.(4.4.5) by assuming that Lq and are 
equal to zero, or similarly, by assuming that Eqs.(3.3.22,23) are satisfied. Of 
course, one cannot satisfy these equations with infinite accuracy and in practice 
Lq and L R will not be exactly zero. Hence the left hand side of Eq.(4.4.8) will not 
be exactly zero but equal to a residual given by Eq.(4.4.5) and which is 

Hi(KL K T - G T L G )IIi T . The accuracy of the error on off-diagonal block elements of 
Mii consequently corresponds to the accuracy at which Eqs.(3.3.22,23) are 
satisfied, times a gain which depends on the magnitudes of G and K, times a gain 
corresponding to the inverse transformation that yields Xjk in Eq.(4.4.8). The 
gain corresponding to the invertion of Eq.(4.4.8) can be very important if the 
eigenvalues inside one compensator are small, and if their difference is small as 
well. When one eliminates the redundant equations, the only means for 
controlling the accuracy of the equations that have been eliminated is to tighten 
the error on Eqs.(3.3.22,23), but such a process may be unsuccessful if the gains 
mentioned above are really large. 


4.4.3 Singularity of the Hessian and Existence of Saddle Points 

First order necessary conditions only show that a point is stationary: the 
variation of the Lagrangian with respect to the problem variables will be zero to 
first order at that point. One must look at the second order conditions to 
conclude on the nature of the stationary point. In this section, we will first show 
that the Hessian is singular if one does not use a minimal set of variables. We 
will also show that some solution points can be saddle points. This last 
characteristic is linked to the controllability and observability of the controller. 
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4.4.3. 1 Singularity of the Hessian 

The first order term in e in Eq.(4.4.3) is zero at a stationary point. Hence, 
Eq.(4.4.3) becomes: 

0 = Trt^ic-S^iy - TrN|Kt| ♦ f ( £ \( e 

where N £ and ( £ are given in Eqs.(4.4.1,2). is a block diagonal matrix similar 
to A c . Hence, the matrix N 2 A C — N^A C N £ shares the same block diagonal 
structure and constitutes, therefore, an admissible perturbation for A c . Thus 

TrL^ (NJA c -N £ A c N £ ) is zero. Similar argument shows that TrNJKLj is zero. At a 
stationary point, satisfies: 

o = * £ T L a « £ , 

where £ £ is defined by Eq.(4.4.2). If the stationary point is a minimum, this in 
turn implies that: 

0 = (4.4.9) 

Every ( £ obtained by changing the realization of the compensator following the 
transformation of Theorem 4.3 is in the nullspace of L^. In order to find a lower 
bound on the dimension of Ker(L^), one can count the number of linearly 
independent such vectors % £ that can be generated using Eq.(4.4.2). The next 
theorem shows that they are, in fact, all linearly independent. 


Theorem 4.4: Let the compensator ( G, A c , K ) be a solution to the optimal fixed 
architecture control problem (Problem 3.1/ The Hessian is singular and its 
nullspace has a dimension greater or equal to n t 2 + n 2 2 + • • • + n p 2 a 


Proof: consider a transformation N(f) as defined in Sect. 4.4.1 such that: 


0 = GN 

m*n c £ 

0 = -N A c + A C N 

n c *n c £ c £ 

0 n , = -N K 


( 4 . 4 . 10 ) 

( 4 . 4 . 11 ) 

( 4 . 4 . 12 ) 


N £ is block diagonal. For simplicity sake, it is assumed that p = 1 and that there 
is only one processor in the feedback loop. If there is more than one processor, 
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one can consider one compensator at a time and augment the plant with the 
remaining loops. The proof can then be worked out for each compensator 
successively. 

Let (A,v) be a pair of eigenvalue and right eigenvector of A c corresponding 
to an observable mode. Eq.(4.4.11) implies that N £ v is an eigenvector of A c as 
long as N £ v is not zero. Postmultiplying Eq.(4.4.10) by v would imply that 
GN £ v = 0 and that the mode (A,N £ v) is unobservable, which is contrary to the 
hypotheses. Hence, N £ v = 0 for every right eigenvector of A c . If A corresponds 
to a Jordan block of size r for A c , consider v such that (v, A c v,* • -.Ac 1 "^) spans 
the invariant space of A c associated with A. Eq.(4.4.11) implies that (N £ v, 
N A c v,- • • ,N g A c r ' l v) is an invariant subspace of A c associated with A and 
Eq.(4.4.10) implies that this subspace is unobservable: N £ v, N £ A c v,- • *,N £ A c r * l v 
must therefore be zero. If A corresponds to a controllable mode, then, calling w 
the left eigenvector associated with A and using Eq.(4.4.12), wN £ = 0. If A 
corresponds to an irreducible block of size r for Ac, there exists w such that w, 
wA c ,* • - jwAc 1 * 1 spans the invariant subspace of A c associated with A such that 
wN £ , wA c N £ , • • • ,wA c r* l N £ are all zero. Eq.(4.4.11) implies that N £ and A c share 
the same invariant subspaces. It has just been shown that if a mode is either 
controllable or observable, N £ is zero on that particular subspace. Therefore, if 
each mode is either controllable or observable, N £ is zero. Hence, the vectors £ £ ’s 
form an independent family of vectors. We have to consider now the 
unobservable and uncontrollable modes. A nonzero transformation N such that 
N £ satisfies Eqs. (4.4.10-12) has the same invariant subspaces as A c (Eq.(4.4.11)). 
Satisfying Eq.(4.4.10) and Eq.(4.4.12) implies that N £ corresponds to scaling the 
uncontrollable and unobservable states. This means that the corresponding £ £ 
vector will be a linear combination of the remaining £ £ ’s. However, the 
transformation that corresponds to changing the eigenvalues of the uncontrollable 
and unobservable modes is one that leaves the cost unchanged. This 
transformation is independent from the others and one has a new independent 
vector to complete the nullspace of L^. Finally, counting the number of 
different possible linearly independent transformations N £ , one finds that the 
dimension of the nullspace of is nj 2 + n 2 2 + • • • + n p J . 
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Theorem 4.3 guarantees that the cost is invariant to all orders when the 
realization of the compensator is changed, but its transfer function is conserved. 
Hence, the problem is under-determined. The singularity of the Hessian 
uncovered in Theorem 4.4 corresponds only to the freedom of choosing one 
representation of te compensator transfer function. The problem is truly 
singular, or admits a critical point, when the Hessian has an extra zero eigenvalue 
that does not correspond to a change in the compensator realization. 


4.4.3.2 Existence of Saddle Points 

We consider in the following that there is a single compensator in the feedback 
loop and that G, A c and K are block partitioned as follows: 


G = [G|G 2 ], A c = 


An A 
Aji A 22 


12 v _ Ki 

22j’ K “ |K 2 J- 


The triplet of matrices ( G, A c , K) can be expanded on a basis of matrices 
(Definition 3.1) and is completely defined by a column vector £ containing the 
free entries of G, A c and K. Assume that £ is formed in the following fashion: 


011 

*1 

Si 

£ — 3-21 

*2 

0 12 

92 

022 


(4.4.13) 


where an is a column vector containing the free entries in A n , k\ is a column 
vector containing the free entries in K b etc. The Lagrangian can be partitioned 
accordingly: 



L L , L 

onOn 0ii*i an<7i 

L fc 1 a ll L k l k l l k l9l L k ia7 


L . L 
Si^i S 1 S 1 
L . L 

O 21 O 11 021*1 02101 


L . L 

Ol 1O21 au *2 OnOi2 

L jfc,jfc 2 L *lOi2 


S1O11 


, L . L 

Sl«2 1 01*2 Sl fl 12 

- L . L 

021O21 021*2 021O12 

1 *2^2 ^20 12 

, L . L 

012021 0i2*2 0i20l2 

L . L 

0202 1 02*2 02012 
O22O11 0 2 2^1 *"*02201 *^022 0 2 i 022^2 O22O12 


'kiQ, 11 ^kik\ ^*^201 ^*^202 


Oi 2 On 
' 020 11 


L . L 

Ol 2*1 01201 

L . L 
02*1 0201 
L 


L L 

01102 O 11 O 22 

&102 fclfl22 
L L 

0102 01022 
L L 

02102 021022 

&202 A2O22 

L L 

Ol 202 O12O22 

L L 

0202 020 2 2 

L L 

02202 O 22 O 22 
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Assume now that A 21 = 0 and K 2 = 0. The modes corresponding to A 22 are 
uncontrollable from K. The compensator matrices have the form: 


G = [Gi G 2 ] , A c - 
The following equations hold in that case: 


An A 12 

V - 

[Kll 

0 A 22 

, & - 

_o _ 


(4.4.14) 


^auai2 

^ ^01102 

0 = L„ „ 
011022 

0 = L fclAl2 

0 “ ^102 

0 ” L Al022 

0 = L„„ 
01012 

1-4 

II 

O 

^ ~ ^01022 

0 = L 

012012 

0 = L 

01202 

0 = L„ „ 
012022 

0 = L„ n 
02012 

o = l„ „ 
0202 

0 = L 

02022 

0 = L n n 
022012 

0 = L„ n 
0 2202 

0 = L„ „ 
022022 

is deferred to 

Appendix B. The proof consists 

of performing the 


derivations of Eqs.(3.3.24-33) in block form. The Hessian becomes: 

L L.L L L.O 0 0 

fluAi &ng\ ^11^21 

L Mii L AiAi L *i0 ! L k ia 2, L k l k 2 0 


L a= 


0 

0 


L L.L L L.O 

0 i 0 n 01*1 0 i 0 i 9 i fl 2 i 9 1*2 

L L.L L L.L L L 

a 2 \ a \\ a 2 \ k \ <22101 <221021 021*2 021012 02102 021022 

^ fc 2 flu ^^ 2 Pl ^^ 2^2 1 kfc 2 fc 2 ^2012 ^^2 ^^ 2^22 

0 0 0 L L i,0 0 0 

012^21 CL \ 2^2 

0 0 0 L_ L.O 0 0 

920-2 1 9 2*2 

0 0 0 L, L , 0 0 0 

<222 021 022*2 


Such a matrix is not definite. Indeed, L^ can be written as: 


L « = 


L n L t2 0 
L 21 L 22 L 23 
0 L 32 0 


, L (2 = L 2 J, L 23 = L 32 ^ 


For any £ = 


' 0 ' 
€a. 
°£s\ 


(4.4.15) 


. £ T L.*£ = ^ 2 T L 2 2^2 + 2a^2 T L 2 3^3- Assuming that L 2 3 is not 


identically zero, there exists £ 2 . £3 and a such that f L^£ < 0. There are also 

£ 2 , U and a such that £ T L^£ > 0. If L u is positive, the compensator will 
correspond to a saddle point for the cost. 0 
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Assume now that G2 = 0 and Au = 0. The modes corresponding to A22 are now 
unobservable from G. The compensator matrices have the form: 


G = [61 0] , A c = 
The following equations hold in that case: 


An 0 
A21 A22 


,K = 


1 1 

h 


( 4 . 4 . 16 ) 


0 * L - 

flllfl 21 

4 

►—3 

II 

O 

0 = L„ „ 
flllA 22 

0 = L *!fl 21 

II 

0 

0 = L * t fl 22 

0 = L„„ 
5 lfl 21 

«-p4 

II 

O 

0 = L„„ 

9 l ffl 22 

^ — ^fl 2 lfl 21 

^ ^fl 21*2 

0 = L„ ■ 

021022 

^ ~ ^* 2 fl 2 l 

0 * L * 2*2 

^ “ ^* 2 fl 22 

0 = L 

A 22 A 21 

^ ^fl 22*2 

0 = L 

022022 


Reordering £ as: 


4 = 


flu 

*i 

fll 2 
9 2 

fl 2 i 

*2 

fl22 


( 4 . 4 . 17 ) 


becomes: 


L « = 


L L.LL L 0 0 0 

flnflii an*i fln^i ttnai 2 flu<72 

L *,fln L *iAi L k x g 1 L A: 1 a l2 L k l92 0 0 0 

L L.LL L 0 0 0 

5iflu 9 1*1 5i5i 9 ifl 1 2 9i9i 

L L.L L L L L.L 

fll2fllt fll2*t fll2#l fll2fll2 fll2^2 Al2fl21 Al2*2 Al2fl22 

L L.L L L L L.L 

$ 2 flll 52*1 929 1 ^ 2 fll 2 9292 9 2 fll 2 £ 2*2 92&22 

0 0 0 L„ „ L„ 0 0 0 

A2lAl2 A2152 

0 0 0 L, L. 0 0 0 

^2^12 #2*72 

0 0 0 L„ „ L * 0 0 0 

A22fll2 0-2292 
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Such a matrix is, again, nondefinite. 


Theorem 4.5: Any stationary point such that the compensator (or one of the 

compensators) has an unobservable or uncontrollable mode is a saddle point. The 
Hessian possesses in that case a nonpositive eigenvalue. If the eigenvalue is 
zero, its associated eigenvector does not belong to the part of the nullspace that 
corresponds to the changing of realization of the compensators. Such saddle points 
always exist if there exists a stabilizing solution for the fixed architecture problem 
obtained by keeping the same control architecture and by reducing the order of the 
compensators. ■ 


Proof: the nondefiniteness of has been shown before. The second part of the 
theorem consists of proving that if the compensator has an uncontrollable or an 
unobservable mode that produces a singular eigenvalue in the Hessian, its 
associated eigenvector does not correspond to a change in compensator 
realization. Consider the case where A 22 is uncontrollable. As seen from 
Eq.(4.4.15), the new eigenvector has the form: 


e- 


0 

£2 

3. 


Hence, following Eq.(4.4.13), £ leaves A u , Ki and Gj invariant. A similarity 
transform N satisfying the same properties must share the block triangular 
partition of A c , Eq.(4.4.14): 


_ N u N,j 
“ 0 N22 


The first order variation of A c and K will be such that A 21 as well as K 2 remain 
invariant. This is equivalent to £3 being zero. The form of in Eq.(4.4.15) 
guarantees, however, that there is a negative, or a singular, eigenvalue with a 
corresponding eigenvector such that £3 is not zero. Thus, the extra zero 
eigenvalue has an eigenvector which does not correspond to a change in the 
realization of the compensator. 

Finally, assume that there is only one compensator (p = 1 ) and assume 
that we are trying to solve the reduced order problem for the system ( C, A, B). 
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weigthing matrices R, V, Rc, V c , with a compensator of order n c = nco- Further 
assume that ( G lt A c i, Ki) is the realization of a compensator that solves the 
reduced order LQG problem for the same plant and for the same weigthing 
matrices but with n c = n c0 — 1 and let Pi and Qi be the correponding solution to 

the associated Lyapunov equations, Pi, Qi € , fti = n + n c o — 1. 

( Gb A c i, Ki, Pi, Qi) satisfy the optimality conditions Eqs.(3.3.19-23) with n c = 
n c o— 1. Consider now the compensator given by: 


G = [Gi 0], G € R mxIlc 


A c = 


Aci 0 
0 -1 


Ac € 


Rnc*n c 


K = 


Ki 

0 


K € R 


n c *l 


Defining the positive semidefinite matrices P and Q as: 


P = 

Q = 


rPio' 

.o °. 

[Qi 0 

0 0 


, P 6 n = n + n c o 


, Q 6 n = n + n c o 


It is easy to verify that ( G, A c , K, P, Q) satisfy the optimality conditions 
Eqs.(3.3.19-23) for n c = n c o- The compensator has an uncontrollable or 
unobservable pole and is therefore a saddle point for n c = n c o- Any solution to 
the reduced order control problem where n c = n c o obtained by appending an 
uncontrollable and unobservable mode to a controller that solves the reduced 
order control problem where n c = n c o— 1 will be a stationary point which is not a 
local minimum but a saddle point. All the reduced order compensator solutions 
can, in particular, be extended by adding unobservable and uncontrollable poles 
to become full order compensator. These solutions are stationary point of the 
LQG problem, but they are saddle points. 
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4.5 CONCLUSION 


It has been shown in this chapter that it is not possible to reduce the complexity 
of the problem by trying to write the optimality conditions in a more structured 
way. Two types of coupling occur when one looks at the fixed architecture 
problem: the first one is a coupling between the filtering and the control 

problems. The separation principle does not hold anymore. Such is already the 
case when one looks at the OPE problem. The structured problem consists then 
of solving two modified Riccati equations coupled by two Lyapunov equations. A 
new source of coupling occurs when one constrains the architecture and splits the 
feedback into p separate processors: Each subcontroller being optimal for the 

system consisting of the original plant and the remaining loops closed, the gains 
and dy nami cs of each compensator will depend on the gains and dynamics of the 
remaining feedback loops. It is not possible, in that case, to decompose the 
problem into a series of smaller problems that have to be solved sequentially. 
The structured problem consists of two modified Riccati equations coupled 
through four Lyapunov equations which yield the optimal coupling between the 
control and the filter problem as well as the optimal coordination between the 
various subcontrollers. The gains and dynamics of the compensators cannot be 
eliminated from the problem in a simple fashion. 

The study of the optimality conditions derived in Chapter 3 have shown 
that the problem is singular. The cost depends only on the compensator transfer 
function, independent of the state space realization chosen to represent it. Any 
set of gains obtained by a similarity transformation of an optimal solution will, 
therefore, satisfy the optimality conditions. It is possible to find a minimum set 
of equations and a mini m um set of variables that will remove this singularity. 
However, such an operation may generate numerical problems, since it is not 
possible to control directly the accuracy of the superfluous equations that have 
been eliminated. Finally, it was shown that if an optimal compensator has an 
unobservable or uncontrollable mode, it will be a saddle point for the cost. 
Optimal constrained solutions become, therefore, saddle points when they are 
expanded to problems with less stringent constraints that allow for compensators 
of higher orders. 


117 


118 


HOMOTOPIC CONTINUATION 


5.1 INTRODUCTION 


The derivation of the necessary conditions for optimality has a limited value 
unless one can find a reliable way to solve for them. It provides an analytic 
expression for the gradient of the cost with respect to the free parameters of the 
problem. At this point, the use of any unconstrained minimization technique 
such as steepest descent, conjugate gradient, quasi-Newton or Newton methods 
should yield solutions corresponding to local minima for the cost. Optimization 
techniques are discussed in detail in numerous references such as [Lue69, Sca85]. 
This direct approach has been taken by many for solving reduced order LQG 
control problems [Bas75, Men75, Ly82, Ly85, Moe85, Cal89], In [Cal89], the 
reduced order dynamic compensator problem is written as an optimal 
decentralized output feedback problem by adding integrators to the plant in 
order to account for the compensator states. The optimum is sought using a 
conjugate gradient method. Developed at Stanford University by Uy-Loi Ly, the 
program "SANDY” [Ly82] is one that has probably evolved as the most user 
oriented software for designing reduced order compensators. It may now include 
more constraints such as H sensitivity constraints and it also addresses some 

QD 

robustness issues in the design. In order to ease the problem of finding an initial 
stabilizing reduced order compensator, Ly considers a finite horizon H2 norm 
Once a solution is found, the final time is increased in order to obtain the 
asymptotic compensator. The minimization is carried out using a first order 
method based on the analytic form of the gradient. In [Gra74], Graupe includes 
the norm of the cost gradient with respect to the plant parameters in order to 
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obtain an H 2 design less sensitive to modeling error. The problem is a different 
constrained H 2 design, but the derivation of the necessary condition for 
optimality is quite similar to the derivations shown in Chapter 3. The numerical 
procedure indicated for solving the problem is a steepest descent algorithm. 

The efficiency of direct minimization procedures is very problem 
dependent. It is usually true that most algorithms need a good starting point in 
order to converge. This implies that one must design a near optimal initial 
stabilizing multiloop compensator with the appropriate architecture. This task is 
not simpler than guessing the optimal solution itself in many cases. 
Minimization algorithms have slower rates of convergence when the Hessian is 
singular at the optimum. One can choose to use reduced or minimal sets of 
parameters to describe the compensator, [Ly85, Cal89]. However, as indicated in 
Chapter 4, extreme sensitivity to parameter changes can arise from such a choice. 
Finally, one still has to worry about the existence of multiple solutions. The 
poor performance and the difficulty to apply a minimization scheme directly has 
led to the development of alternate solution techniques. 

As indicated in [Hyl84], the reduced order compensator problem retains 
some structure that is captured by the Optimal Projection Equation formulation. 
[Gru86] uses an iterative method for solving the OPE similar to that of [Hyl83], 
The method is based on successive iterations and reduction of the size of the 
eigenvalues of the coupling matrix r. The method can be seen as an 
improvement of previously developed substitution algorithms such as the ones 
proposed in [Lev70, Joh70, And71] which are already an adaptation 0 the 
reduced order compensator problem of iterative methods for solving the full order 
compensator problem [Kwa72b], The coupling matrix is set initially to be the 
identity matrix which corresponds to the full order LQG problem. The initial 
solution is therefore easy to obtain and, as some of the eigenvalues of r go to 
zero, the matrix becomes a projection operator. The main disadvantage of the 
technique is that the successive iterations have no guarantee of converging even if 
a solution exists: the algorithm can be numerically unstable and can, therefore, 
fail to provide any answer at all. Designs similar to those presented in [Ly85] are 
reproduced in [Gru86] using the iterative technique. The problem is to optimally 
control a 7 th order plant corresponding to the longitudinal dynamics of an 
aircraft augmented by the wind gust dynamics using a 4 th , a 3 rd , and a 1 st order 
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compensator. The iterative method appears to converge more slowly than the 
minimization techniques and to achieve a smaller accuracy, especially when 
searching for the 1 st order compensator. Moreover, the technique cannot be used 
to synthesize a fixed architecture compensator since most of the structure of the 
solution has vanished, as shown in Chapter 4. The only obvious substitution 
scheme is, in that case, to find P and Q as functions of G, A c and K by solving 
the Lyapunov equations Eqs.(3.3.19,20) and find, next, G, A c and G as functions 
of P and Q by solving the systems of equations of Propositions 4.3 and 4.4. This 
approach is almost never successful. Another approach proposed in [Ber87b], and 
can only be applied to fully decentralized control (no sensor or actuator shared by 
any two subcontrollers), is to sucessively optimize each subcontroller. This has 
no guarantee of finding the optimal solution, and it may have poor convergence 
properties since the optimization of one subcontroller may have adverse effects on 
the optimality of the remaining loops which are kept fixed. 

The only method found in the literature for solving the fixed architecture 
control problem in a global fashion has been that of [Wen80]. It considers the 
problem as an optimization problem with equality constraints: instead of looking 
for G, A c and K in matrix spaces of reduced dimensions so that they satisfy the 
order and architecture constraints, the constraints are relaxed and the feedback 
may be a centralized full order system. The Lagrangian is then augmented with 
the weighted sum of the squares of the entries in G, Ac and K that should be 
zero. The algorithm becomes an unconstrained optimization problem for which a 
conjugate gradient method is applied. [Wen80] shows that if a solution to the 
constrained architecture problem exists, it will be one minimum of the 
augmented problem. A very simple output feedback problem is shown to 
illustrate the method. The advantage of this approach is that the initial design 
can be the full order LQG compensator. However, there is no guarantee that 
such an initial guess will converge to the minimum corresponding to the fixed 
architecture compensator. In the case of the dynamic compensator, the method 
may end up finding a specific state space representation of the full order 
compensator rather than converging on the fixed architecture compensator. One 
must then iterate on the starting point. Such a task may turn out to be very 
difficult. The weighting imposed on the structural constraints may then have to 
be very large and can make the problem numerically ill-conditioned. These 
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problems do not appear, however, in the static output feedback problem treated 
in [Wen80]. 

Continuation, or homotopy methods have appeared to be a very promising 
approach for solving complex constrained control synthesis problem. Their 
successful use has been reported on many occasions in [Mon69, Lef85, Seb86, 
Kab87, Ric87, Ric89, Pet90j. As argued in [Ric89, Hyl90], these methods tend to 
be the only ones that work when the problem is numerically ill-conditioned. 

The basis for the use of continuation methods is to have a problem that 
depends continuously on some design parameters so that the solution can be 
continuously differentiated with respect to them. The problem has the generic 
form 


0 y = F(X,q) 


(5.1.1) 


where F is a continuously differentiable function depending on a parameter a 
mapping a finite dimensional vector X into some vector space V. Differentiating 
Eq.(5.1.1), one gets 


°V “ F X’ X a + 


a 


(5.1.2) 


Denoting by Xo a solution to Eq.(5.1.1) for a = ao, a solution to Eq.(5.1.1) for a 
= ati can be obtained by integrating Eq.(5.1.2) 


X(Q t ) = X(a 0 ) - 


a i 

F y -‘F„ da 
J X a 


ao 


(5.1.3) 


Eq.(5.1.3) holds as long as the integrand inside the integral sign is a well defined 
quantity, which is equivalent to saying that the Implicit Function Theorem 
applies for every a 6 [ ao, aj, [Llo78j. Two solutions X(ao) and X(ai) will be 
qualitatively of the same nature if there exists a path of solutions connecting one 
to the other. 

The main difficulty in applying homotopy is to be able to determine if all 
the solutions to the final problem can be reached through homotopy by following 
the solutions to the simplified problem. An attempt to answer these questions 
has been made in [Ric87, Ric89j. The theoretical basis to such a problem is 
covered by topological degree theory [Llo78, Eav83], It is shown that under 
certain conditions the number of solutions to Eq.(5.1.1) remains constant, 
independent of a. The result clearly holds for the full order LQG problem, but it 
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will be shown that a global result cannot be obtained for the more general 
constrained problem. 

The remainder of this chapter is organized as follows. The next section 
shows how to use homotopy to solve the optimal fixed architecture control 
problem. The question of choosing a deformed simplified problem is addressed, 
the derivative of the optimality equations with respect to the homotopy 
parameter is given and it is shown that the singularity of the problem due to the 
freedom in choosing the compensator realization does not prevent one from 
defining an integrand and computing the integral in Eq.(5.1.3). 

Based on these preliminary steps, a continuation algorithm is developed 
for solving the Fixed Architecture Control problem. The algorithm combines a 
simple Euler forward integration scheme to evaluate the integral and a 
minimization scheme using a mixed steepest gradient / Newton-Raphson scheme 
in order to control the error. 

One can locally track the solution of any control problem using a 
continuation method. A more important question is to know if the property is 
global. To that effect, one must check that continuous paths connect the 
solutions of any two control problems with different design parameters. One 
must also be able to find the entire set of solutions for simplified problems. 
Finally, one must deal with critical points. Studying the question for the reduced 
order problem, which can be stated in the form of the Optimal Projection 
Equations [Hyl84], original examples are derived in this chapter to show that: 

— not every stabilizing solution to the simplified problem connects to a 
stabilizing solution to the final problem; 

— all solutions to simple diagonal problems cannot be systematically found; 

— bifurcations can occur along a solution path; 

— the nature of the solution can change along the path. More particularly, 
local minima can become saddle points and stabilizing solutions may 
become nonstabilizing solution in a continuous manner. 

The contribution of this chapter is to characterize the behavior and the nature of 
the solutions to the constrained H 2 problem. The results derived in the following 
sections prove that homotopy cannot be used as a global tool to find all the 
solutions to the Fixed Architecture Control Problem and indicate that any 
successful numerical procedure must provide ways to abandon a solution which 
ceases to correspond to a stabilizing solution and a minimum. A second 
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conclusion is that the choice of the initial simplified problem will be very 
important. A design example illustrates this fact and shows that, by not 
choosing a starting problem close enough to the problem of interest, one may not 
find a continuous path of solutions between the two problems. A proper choice of 
the initial problem, however, results in a very smooth behavior of the solution 
along the path and very good convergence properties. 


5.2 HOMOTOPIC CONTINUATION METHOD 
5.2.1 Deformed Problem and Initial Solution 

In order to use a continuation method, one must find a famil y of control 
problems that depend on a parameter a such that a = 0 corresponds to a 
problem to which some, or all the solutions are known and a = 1 corresponds to 
the control problem one wishes to solve. Consider the Fixed Architecture 
Control Problem 3.1 whose design parameters are 


(Co,Ao,Bo) 

plant Co € R 1 * 11 , A 0 € R n,<n , B 0 6 R n “ m 

Vo 

process noise covariance, V 0 6 R n * n , 

V c o 

measurement noise covariance, V c o 6 R^^ 

Ro 

penalty matrix on the states, Ro 6 R n * n , 

Rco 

penalty on the control inputs, R c o € R m * m 


along with the specification of the architecture, 

p number of loops, 

ni order of subcontroller i 

Hi, set of actuator indices belonging to subcontroller i, 

J>i, set of sensor indices belonging to subcontroller i, 
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The parameters of the problem are assumed to have the following form: 


II 

0 

An 0 • • • 0 0 

0 A 22 0 0 

• • • 
• • • 
• * • 

,Bq= 

Bn 0 • • • 0 

0 B 22 0 

• • 

• « 

• • 

,Co= 

C 11 0 • • • 0 0 

0 C 22 0 0 

• • • 
• • * 
« • • 


0 0 • • • App 0 

0 0 • • • 0 Ap*i p *t. 


0 0 • • • Bp P 
0 0 • • • 0 


0 0 • • • Cpp 0 


Aii 6 R ni * ni , ni= order of compensator i, i < p, 

Bii € R ni *— \ mi € W, mi < mi number of actuators retained in loop i as specified 
by U\ 

Cii 6 R^“ ni , h € IN, li < li number of sensors retained in loop i as specified by 7i, 


VuO • 
0 V 22 


0 0 
0 0 • 


0 0 
0 0 


, Vco = blockdiag(Vio, Vao.* • ‘.Vpo), 


Vp P 0 

0 Vp+ip*i 


Vii € R ni * a \ positive, Vi 0 6 R 1 ^ 1 ', positive definite, 


R 11 0 • • * 0 0 

0 R22 0 0 


0 0 Itpp ® 

0 0 • • • 0 Rp+ip+i. 


R c0 = blockdiag(Rio, R 20 >* • # >Rpo), 


Rii 6 R ni “ ni , positive, Rio € R mi * m \ positive definite. 


The architecture is such that the first mi actuators and li sensors are used by 
subcontroller 1, the next m 2 actuators and 1 2 sensors are used by subcontroller 2, 
etc. This is not a restrictive hypothesis since one can renumber the sensors and 
actuators. 

Systems for which the design problem simplifies are systems constituted of 
completely independent subsystems, each of them having its own sensors, 
actuators, independent cost and independent disturbance. The global cost is the 
sum of the costs defined for each subsystem. The dynamics of the subsystems are 
totally uncontrollable and unobservable from all actuators and sensors except 
their own. The fixed architecture problem decouples, in that case, in a number of 
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smaller centralized full order control problems. If the architecture allows for a 
sensor to be shared by two or more subcontrollers, the shared sensor will affect 
only one of the smaller centralized control problems since only one subsystem is 
observable from this particular sensor. Hence, the effective number of nonzero 
rows li in Cu may be smaller than h, the number of sensors connected to 
subcontroller i. Using a dual argument about controllability, one can see that the 
number of nonzero columns aii in Bu may be smaller than mi, number of 
actuators used by subcontroller i. 

The simplified system, defined above, is made of the aggregation of p 
separate smaller LQG problems. The plant is made of the aggregation of p+1 
subsystems, p of which have their own set of sensors and actuators, the last one 
being both completely unobservable and completely uncontrollable. Neither the 
cost nor the various noises entering the systems couple the different subsystems 
together. Hence, for this very specific type of plant, the Fixed Architecture 
Control Problem decouples into p unconstrained LQG problems. 

Consider, now, Problem 3.1 with the same architecture and same matrix 
dimensions, but with design parameters ( Ci, A t , B t ) for the plant, V! and V C1 for 
the process and measurement noise covariances, R 1 and R^ for the penalty 
matrices on the states and the control inputs. Define the intermediate problems 
corresponding to the following parameters 


A(q) = A 0 + f l (a)(Ai-A 0 ) 

(5.2.1) 

B(a) = Bo + f 2 (a)(B 1 -B 0 ) 

(5.2.2) 

C(Q) = C 0 + f 3 (a)(C 1 -C 0 ) 

(5.2.3) 

V(a) = Vo + f^aXV^Vo) 

(5.2.4) 

R(a) = R 0 + f 5 (a)(Ri-R 0 ) 

(5.2.5) 

V c (a) = V c0 ♦ f 8 (a)(V c ,-V c0 ) 

(5.2.6) 

R c (a) = R c0 + f 7 (a)(Rci-R c o) 

(5.2.7) 


where a 6 [ 0, 1], and where fi(a) are right differentiable functions such that f,;(0) 
= 0 and fi(l) = 1. Eqs.(5.2.1-7) define a one-parameter family of problems that 
starts as a series of simpler decoupled LQG problems ( a = 0) and continuously 
deforms into the actual control problem ( a = 1). If a continuous path of 
solutions exists, one can find solutions to the Fixed Architecture Control 
Problem. The simplest choice for fi is to take fj(a) = a. This produces a linear 
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deformation of the parameters of the problem. A piecewise linear transformation 
can be obtained simply by defining intermediate problems and applying a linear 
transformation between them. For each new intermediate problem, the starting 
solution is the one obtained from the previous problem. The procedure is started 
with a simplified diagonal problem. The numerical procedure inplemented in the 
following sections utilizes a linear transformation of the parameters and allows, 
as just argued, piecewise linear deformation of the parameters. 


5.2.2 Solving L^-£ Q + L^ = 0 
5.2.2. 1 Analytical Aspect 

Following the notation of Chapter 3, the Lagrangian L depends on a vector £ 
containing the free parameters of the controller gains and dynamics (it is 
assumed here that the matrices P and Q have been eliminated by solving 
Eqs.(3.3.19,20)). The Lagrangian depends also on the design parameters which 
can be represented by a single parameter a if they are given by Eqs.(5.2.1-7). L 
can thus be formally written as L(£,a). The optimality condition becomes: 

0 = LJt,a) (5-2.8) 

Differentiating Eq.(5.2.8), one obtains the following equation 

° = W L {a < 5 ' 2 ' 9 > 

where is the Hessian, ( Q is a vector containing the derivative of £ with 
respect to a and L^ Q is the partial derivative of the optimality conditions with 
respect to a. L^ a can be obtained following steps similar to Eqs.(3.3.26-33). P Q 
and Q a are solutions of the following Lyapunov equations: 

««.# * »el T P Q ^ P a *=l * *c & * PAcl Q * ».l a (5.2.10) 

°».6 ■ *<l«a * A Q *'‘ T * *cl Q « * 1*4 * H, < 5 - 2 - U) 
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where: 


*cl a = 


\ B a G 
“a 0 


’ Hu* 


l a 0 
0 6^R Cq G 


■ » V 


V a 0 

0 Wc a l\ 


(5.2.12) 


and where A Q) B Q> C Q , R Q , V Q , Rc a and V Cq are obtained by differentiating 
Eqs.(5.2.1-7) with respect to a. Define: 


M =P Q + PQ 
a cr 


Partition P . and hi as: 
a’ a a 


P 


a 


a 

D a -i 

00 

Poc 

OL 

p o, 

cO 

r cc. 



■Qoo Qoc' 

, I = 

r«Q u a i 

loo *0c 

,q?o q?c. 

’ a 

1 

V 

o 

» 


Using the chain rule, 


L AcO- L Gq “ d L Ka become: 


Hence: 



- M a 

- ®cc 

- Rc a GQ cc + 
= P cc KVc a + 


R C G Q? c - B^c 
P? C KV C + M? 0 C T 


^a\a 

l 9\a 

l ha 


= TrE a i T M? c 
= TrE^ T (R CQ Gq cc + 
= TrE A i T (P cc KV CQ + 


R C G q? c + B T M^ c ) 
P?cKV c + M? 0 C T ) 


( 5 . 2 . 13 ) 

( 5 . 2 . 14 ) 

( 5 . 2 . 15 ) 


L* is the column vector composed of the elements L , 
£<* * 9iQ' 


L ^ and L. . 
diet k\a 


As seen in Sect 4.4, any change in the realization of the compensator 
transfer function leaves the cost invariant and, consequently, the Hessian L,, is 
singular. It can be shown, however, that the vector is always orthogonal to 
the vectors Eq.(4.4.2), that span the nullspace of the Hessian Ker(L^). 
Eq.(5.2.10) and Eq.(5.2.11) are the differentiated form of Eq.(3.3.19) and 
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Eq.(3.3.20) with respect to a. Because the two equations still hold after 
differentiation, Eq.(4.4.4) also holds in a differentiated form. Hence, 


= ni ( L Aca Ac " AcL Ica + L Ga G “ KL Ka) ni 


i = 1, 


G, A c and K are constant parameters in Eqs.(5.2.10,ll) and consequently G Q 
A c and K are zero. Consider now N £ to be the gradient of a similarity 
transformation as defined in Theorem 4.3. N £ is block diagonal and therefore, 
using the above result, the following holds, 


0 = Tr ( L AcQ Ac “ AcL L* L Ga G “ KL L^ N e 
or, after rearran g ing the expression using the properties of the trace, 


° * Tri I ca (-V'=* 4 ‘ , y * Tri L G " £ - iri io¥ 

The right hand side of the equation corresponds to the matrix formulation, 
Eq.(3.3.1), of the inner product between L^ a and £ £> where f £ is given in 
Eq.(4.4.2). The above formula states therefore that L^ Q is orthogonal to any of 
the basis vectors of Ker(L~) that correspond to a change in the compensator 
re ali zation - does not affe ct the realization of the compensator. As long as 
does not have any other singularities, Eq. (5.2.9) will admit at least one 
solution. This result means that the real variable is not a vector but an 
equivalence class in the vector space of the compensator realizations. Two 
compensators are equivalent if they realize the same transfer function. The 
solution to the optimal control problem is in fact a transfer function independent 
of any particular state space representation. Factoring out the nullspace of L. 
in the problem, one removes the singularity and obtains a problem similar to that 
of Section 5.1. In practice, the solution obtained by solving Eq.(5.2.9) contains 
two components: one is orthogonal to the nullspace of L^, Ker(L^), and 

describes the changes in the compensator transfer function. The second 
component of is parallel to Ker(L^) and describes a change of realization of 
the compensator state space description. The freedom resulting from choosing 
the component of along Ker(L^) can be used to obtain better numerical 
properties. 
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5 2.2.2 Practical Aspect 

The following methods can be used to find ( numerically: 

1) Use of A minimal set of equations and a minimal set of parameters: 

As seen in Section 4.4.2. 1 and Section 4. 4. 2. 2, one can find a realization for the 

compensator such that only a reduced number of variables are needed. Similarly, 

only a reduced number of equations need to be satisfied. Calling £ a vector 

0 

made of this reduced set of components, Eq.(5.2.9) becomes: 

0 = L e e •( . +L. 

where L, , does not have a nullspace corresponding to a change in compensator 
? <ro 
realization. 


2) Minimal set of parameters, complete set of equations: 

The compensator is described by a minimal set of parameters £o- All the 
necessary conditions are, however, considered. Eq.(5.2.9) becomes: 





This system has more equations than unknowns, but it has one solution that can 
be obtained using a least squares method. 


3) Nonminimal set of para meters, full set of equations: 

The compensator is described by a reduced but not minimal set such as the 
modal description of Section 4.4.2. 3. Eq.(5.2.9) becomes: 


0 = L 






where ( is a reduced vector representing the nonminimal set of variables. The 
least squares solution can be obtained numerically. 
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5.3 A CONTINUATION ALGORITHM 


5.3.1 General 

The use of homotopy has transformed the resolution of the optimal control 
problem into a simple integration problem. Many numerical schemes have been 
developed for that purpose [Pre86] and the main difficulty encountered by any 
method is to stabilize the scheme and control the size of the error. These 
difficulties c an be overcome when one uses a continuation scheme, since the 
calculated solution £(a) must always satisfy Eq.(5.2.8). It is therefore possible to 
monitor the error and take steps to reduce it. Different ways have been proposed 
to stabilize the integration. In [Mon69], a descent component is added to the 
gradient of the cost with respect to a. The forward step then tracks the solution 
path and tries at the same time to reduce the error inherited from the previous 
step. [Kab87] remarks a more systematic approach which consists of performing 
a minimization step after a forward step has been taken. A very similar 
approach is taken in [Ric87, Ric89] where the method relies in fact only on a local 
search of the solution: the gradient of the solution with respect to a is not 
calculated, and instead, the homotopy parameter is simply incremented. The 
previous solution is then used as the starting point of an iterative approach 
similar to [Gru86]. This last procedure suffers, however, the same shortcomings 
as the procedure developed in [Gru86] since the local search may itself be 
numerically unstable. 


5.3.2 Structure of the Algorithm 

The algorithm proposed here is a continuous homotopy algorithm with 
minimization steps to stabilize the forward integration. The gradient is 
calculated and a is increased until the norm of the gradient ||L^|| is within 10% of 
a threshold £ 7 . This step is denoted as the shooting step. The norm of the 
gradient is then reduced using a mixed steepest descent / Newton-Raphson 
method until the error becomes smaller than a second threshold £ 0 • If the 
minimization fails, the shooting step is halved in order to start the minimization 
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at a point closer to a solution point. The structure of the algorithm is the 
following: 

Step 1 : a. = 0 

Find initial solution to the diagonal problem 
or use existing solution of an already 
known nondiagonal problem 

Step 2 : Compute the gradient £ 

Step 3 : Shooting step: 

find Aak such that 

aic*i = Qk + Aak 

+ <a k A ° l 

0.9 £j < ||! { ({J ii )|| < 1.1 £, 

Step 4 : Minimize L at ak*i: 

Initialize search at . 

kn 

If a < 1, minimize until ||L^(^ k ^)|| < e 0 

If a ss 1, minimize until ||L*(£ )|| < e x 

s k+l 

Step 5 : If minimization fails, 

halve Aak, repeat 4. 

If minimization successful, accept £ 

k*l 

Step 6 : Repeat Step 2 through 6 until a = 1. 

Two thresholds are used for minimization purposes. A coarser £o is used 
throughout the integration. When a = 1, a smaller threshold is used to 

improve on the accuracy of the final solution. The value of £2 drives the size of 
the shooting step and should be set as large as possible. If £2 is too large, 
however, the minimization may start too far away from a solution and £2 must be 
chosen so that one stays in the region of rapid convergence of the minimization 
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ERROR 


scheme. The minimization can be started with steepest descent steps which are 
more robust far away from a solution, thus allowing larger e 2 . When closer to a 
solution, the algorithm takes modified Newton’s steps which have a higher rate of 
convergence. The Hessian must be calculated and inverted in order to get the 
direction in the shooting step and one can therefore use the same routine in order 
to get the descent direction of the modified Newton step. Figure 5.1 shows how 
the error evolves as a function of a. The size of the step varies depending on the 
sensitivity of the solution to plant parameter variations and design parameter 
variations. 



Figure 5.1: Variation of the Gradient Norm during the Homotopy 
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5.3.3 Choice of the Free Parameters 


The general structure of the algorithm does not depend on the parameters chosen 
to describe the compensator in state space. The details of the calculations are 
however dependent on that choice as highlighted in Section 5.2. 2. 2. The modal 
form described in Section 4.4.2.3 appears to be a well conditioned 
parameterization that leaves only ni extra degrees of freedom per loop. These 
extra degrees of freedom correspond to the possibility to change the scaling of the 
various states without modifying the block structure of the realization. Problems 
can occur, however, when eigenvalues from two different blocks merge and form a 
complex conjugate pair . The hypothetical root locus of Figure 5.2 illustrates 
such a problem. In the example depicted, A c is four dimensional and has two 
diagonal blocks. The complex conjugate eigenvalues 1 and 2 belonging to one 2*2 
block of A c in modal form merge and then split on the real axis to give 
eigenvalues 5 and 6. Similarly the complex conjugate pair 3 and 4 which belongs 
to a second 2*2 block merge and split on the real axis to give eigenvalues 7 and 8. 
If the eigenvalues keep shifting and 5 and 8 become 9 and 12, and 6 and 7 become 
10 and 11, 10 and 11 must then belong to the same 2*2 block in the modal 
representation of A c . These eigenvalues come from two different blocks, however. 
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This implies that the blocks must be changed in order to allow 6 and 7 to become 
a complex conjugate pair of eigenvalues. The root locus cannot, therefore, be 
obtained by the continuous deformation of a matrix in modal form. The 
discontinuity problem must be overcome by adding some extra degrees of 
freedom and letting, for example, the dynamic matrices Ai be tridiagonal. Such 
a realization allows for 3*ni-2 extra degrees of freedom to realize differently the 
transfer function of the i th subcontroller,, versus ni for the modal form, and im 2 
for the most general representation. Let £, Eq.(3.3.24), be the vector of all the 
free entries in A c , G and K that have not been set to zero when fixing the control 
architecture. Specifying a tridiagonal form for the Ai results in constraining 
some entries in to be zero or, in other words, it constrains ( to lie in a subspace 

S D of IR np , where n p is the dimension of £. Let D be a diagonal matrix of size n p 
whose diagonal is defined by: 

D(i,i) = 1 if ^ is free 

D(i,i) « 0 if is constrained to be 0. (5.3.1) 

Define the vector £ as 

£ = D£ (5-3.2) 

£ is the expanded form of the vector containing the free parameters of the new 
problem. The solution to Eq.(5.2.9) will be constrained to be in S^. Because the 
set of parameters is not minimal, one still has some freedom in choosing the 
solution in Sjy The solution chosen will be the one of smallest norm in S^. The 
advantage in restricting the solution to be in is that one does not have to 
compute the whole Hessian but only the columns corresponding to the free entries 
of £ . This will, first, save computational time and, second, reduce the 

d 

dimension of the nullspace of the Hessian on S^. 
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5.3.4 Modified Steepest Descent Step 


Denoting by £ the value of the vector at the k th step of the minimization, and 
by g the error vector equal to 

the cost is to first order: 

Taking a step equal to 
A£ = - o-kDgk 

dk 

the cost becomes 

L ^dk + ^diP = L ^dk^ " ^kgkDgk + 0(<r k 2 ) 

and will be locally decreasing for <7k sufficiently small since D is a symmetric 

positive matrix thus making gkDgk a positive quantity. If gkDgk is zero, then 
Dgk must be zero and, following the results of Section 4.4.2, the entire error 
vector gk must be zero. Hence, the step is similar to a usual steepest descent 
step, a k is found to minimize the cost along the direction -Dgk using a 
bracketing technique [Sca85]. 


5.3.5 Modified Newton-Raphson Step 

Newton’s method has a quadratic rate of convergence when the Hessian matrix is 
positive definite. is singular at any solution point as seen in Chapter 4, but 
the cost is invariant to every order in a change in the realization of the 
compensator transfer function. Hence, one can expect the convergence rate to 
remain quadratic close to the solution. Far away from a stationary point the 
Hessian regains its full rank since the gradient vector L^, if it is not zero, will 
depend on the realization of the compensator. Some eigenvalues of the Hessian 
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must then go to zero as the error is reduced. One cannot rely on the direction 
indicated by the eigenvectors associated with these eigenvalues in order to find a 
search direction since these eigenvalues may not be positive. The search 
direction d£ is computed as follows. First, one must be sure that the search 
direction will be in to preserve the type of realization chosen for the 
compensator. The following matrix Ldd is used instead of the Hessian: 

Ldd = DL^D (5.3.3) 

where D is given in Eq.(5.3.1). Ldd maps Sp into itself and into zero. Ldd 
is a symmetric matrix, hence diagonalizable, and can be expanded in the 
following sum: 


N d 

T 

Ldd — E AiUiUi 
i * 1 

where the ut are the eigenvectors of Ldd belonging to S^, where the Ai’s are the 
corresponding eigenvalues arranged in decreasing order, taking their sign into 
account, and where Nd is the number of free entries in £ . The remaining 

eigenvectors span the nullspace of Ldd which coincides with Define the 

matrix Hk as: 


N n . 

Hk = E t .UjUj 
i « 1 1 


T 


where N B is the minimal number of parameters required to fully describe the 
compensator’s transfer function. As one approaches the solution, the remaining 
Nd— N b smallest eigenvalues of Ldd go to zero. The search direction d£ * s 
defined by: 


d£ = — Hkgk 

*» dk 

The step is admissible since Hk, like Ldd, maps R np into S^. To first order, the 
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cost becomes 


L ^dk +<Tkd ^dJ = L ^dk^ ~ ^kgkHkgk + 0(<7k 2 ) 

and will be locally decreasing. < j \ can be chosen to minimize the cost along the 

search direction. The step becomes = <7kd£ . The cost is reduced at every 

dk dk J 

step and, eventually, the step <7k will converge to 1, or to a full Newton step. 


5.3.6 Convergence Properties 

The minimization procedure used in the algorithm has convergence properties 
similar to those of other classic second order methods [Sca85]. When close to a 
minimum, the method is guaranteed to converge quadratically. Because a 
gradient step is used, and because line searches are performed during the 
minimization, the algorithm is guaranteed to provide a minimum. Since the 
minimization always start from a stabilizing solution, such a solution must exist. 
The convergence properties may be poor if the starting point is close to another 
stationary point which is not the minimu m * 

The shooting procedure guarantees that the starting solution obtained for 
the next minimization step will be dose to a local minimum As long as there is 
no critical point along the path, that is, the nullspace of the Hessian remains 
limited to those transformations that modify the compensator realization, and as 
long as the path connects stabilizing solutions, the shooting step will always 
produce a near optimal solution. The quality of the solution can be controlled 
using £2- The following sections study if the singular cases just mentioned can 
occur, that is, the possibility for the dosed loop to become unstable, or the 
possibility for the solution to encounter a critical point. In such occurrences, the 
shooting step will tend toward zero, or the initial point it provides to the 
minimization will cease to be a local minimum. 


138 



5.4 ON THE NUMBER AND NATURE OF THE SOLUTIONS TO THE 
CONSTRAINED H a PROBLEM 


5.4.1 General 

L.(£,a) is a continuously differentiable function of ( and a. One can therefore 
track the solution to Eq.(5.2.8) at least locally, except possibly in some very 
pathological case corresponding to critical or bifurcation points. A more 
important question is whether or not, and under what assumptions, the property 
becomes global. [Ric87, Ric89] try to answer such questions using topological 
degree theory [Llo78]. The proof is worked for the full LQG problem, but does 
not generalize, however, to the fixed order control problem and, consequently, to 
the fixed architecture control problem as the following sections will show. The 
question will be examined for the reduced order problem for which the optimality 
conditions can be stated in terms of the Optimal Projection Equations (OPE). 

1 The following examples demonstrate that the OPE have possibly many algebraic 
solutions. Some of the solutions do not stabilize the plant while others do, and 
some stabilizing solutions can be local minima for the cost or saddle points. A 
series of examples will prove that the nature of the solution is not invariant along 
a solution path, and that stabilizing solutions can continuously become 
nonstabilizing, while minima can become saddles. These results point out that 
no global properties exist for the reduced order case, or for the fixed architecture 
case, which generalizes it. 


5.4.2 Degree Theory 

The following section presents the main definitions and results of degree theory. 
A complete treatment of the subject can be found in [Llo78, Eav83j. 
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Definition 5.1: Let D be a bounded, open subset of R n , P a point of\ R n . IT is the 

closure o/D, dD its boundary. Ci(IT) is the space of continuously differentiable 

functions defined on an open set containing D that maps D in R°. Let $ e C l (D), 
P € R n . = det(4> x ) is the Jacobian ofi (). X is said to be a regular point forty if 
* 0. X is a critical point otherwise. P = <j>(X) is said to be a critical value if X 
is a critical point. The set of critical values is caUed the crease of the Junction. 

Suppose $ 6 C l (D), P l <K0D), P t crease of ty. Define the degree of ty at P 
relative to D to be deg( <{>, D, P), where 

deg( D, P) = E sign JL(X) 

Xe<t>-‘(P) 


Since D is compact and P is not in the crease of <J), the problem <J>(X) = P has a 
finite number of solutions and the summation is finite. Also, if deg( <j>, D, P) $ 0, 
<J>(X) = P has at least one solution in D. 


Theorem 5.1: Consider the continuous mapping H: D * [0,1] -* Rn, h t = H(X,t). 
Assume that h t (X) = P has no solution on dD for any t € [0,1]. Then, 

deg( h 0 , D, P) = deg( h,, D, P). 

Let D be an open, bounded set of C n , and <f> an holomorphic mapping on C n . If 
P i <j)(5D) ; then deg( <^, D, P) > 0. 


Proof: the proof is in [Llo78]. The theorem states that the degree is invariant 
under homotopy. This means that, if no solution appears or disappears on the 
boundary, new solutions have to appear and disappear in pairs, one satisfying 
> 0, the other < 0. If the degree is nonzero, there is at least one 
continuous path of solutions connecting the solution of ho(X) = P to the solutions 
of hi(X) = P. The homotopy invariance is illustrated by Figure 5.3 taken from 
[Llo78]. An holomorphic mapping is orientation preserving. Hence, when ty is 
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analytic over the domain, the degree is exactly equal to the number of solutions 
of <j>(X) = P for P € D. In that case, the only way for a solution to appear or 
disappear is to go to infinity. 



Figure 5.3: Solution Path under Homotopv 
Dashed lines do not exist if degree is constant 
Closing oaths do not exist if the function is holomorphic 
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5.4.3 Boundedness of the Solution along a Path 


Theorem 5.2: Let G, A C( K, P, Q, P, Q , t be a solution to the OPE problem, 
Eqs.(4.3.35— 39), for a plant such that 

( C, A, B) is detectable and stabilizable, 

( R 1 '' 2 , A, V^ 2 ) y detectable and stabilizable. 

Assume that ( G, A c , K) is both fully observable and fully controllable. Then, as 
the parameters of the problem C, A, B, R, V, R* and V c are continuously varied 
in a compact domain in such a way that the above hypotheses are always satisfied, 
and assuming also that r, P r^ and r^Q remain bounded abng the solution path, it 
is true that P and Q remain bounded along the solution path, and that the 
corresponding matrices G, A c and K remain bounded as well. No mechanism, 
however, prevents r, P or rQ from going to infinity depending on the 
particularity of the problem. 

Proof: 

1) Pr and rQ remain boun ded along the solution path 

The proof is by contradiction. Assume that there is a sequence of problems 
defined by ( Cj, Aj, Bj) Rj, Vj, R CJ and V C j satisfying the detectability and 
stabilizability hypotheses converging toward ( C, A, B), R, V, R c and V c such 
that PjTj goes to infinity, r being assumed bounded, there is a sequence of 
unitary vectors Uj such that : 

<TjVj = PjUj, Vj unitary, o-j - a (5.4.1) 

Pre and postmultiplying Eq.(4.3.35) by Uj T and uj, and using Eq.(5.4.1), we 
obtain: 


T, T 


0 = <TjUj*Aj 4 Vj + crjVj A AjUj + Uj A RjUj -<rj 2 Vj 1 EjVj + Uj T rj^PjEjPjrj^Uj 


T T 

u j r j x ^j^j^j r j x u j remains bounded since Pr^ is bounded by assumption. Thus, 
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in the limit v T Ev = 0, or, since E is positive, 


0 = E^v 


(5.4.2) 


Dividing Eq.(5.4.1) by and multiplying it by Pjt, one gets in the limit: 

0 = Ptv (5-4.3) 

where Pi is a generalized inverse defined as: 


Pt = W 


'D' 1 O' 
0 I 



W, and D being defined by 


P = W T 


D O' 
0 0 . 


W, D diagonal, D > 0, W unitary. 


Note that P is definite if ( R^ 2 , A) is completely observable, but it may have a 
nullspace if A has a stable mode not weighted by R. PtP is an orthogonal 
projection parallel to Ker(P). Any vector v, the limit of a sequence of 

eigenvectors Vj such that ®, satisfies Eq.(5.4.2) and Eq.(5.4.3). 
Postmultiplying now Eq.(4.3.35) by Uj, premultiplying by Pjt and dividing by ay 


0 = PjUj T Vj + PjtPjAjUj/oj + PjtRjUj/(Tj -PjtPjEjVj + Pjirj x PjEjPjTj A Uj/<rj 


Pji as well as PjiPj are bounded, and in the limit EjVj goes to zero. Hence, in 
the limit: 


0 = Pt A a v 


(5.4.4) 


T T 

Combining Eq.(5.4.3) and Eq.(5.4.4), Ker(Pt) is invariant under A . A must 
have a mode defined by ( A A , w A ) such that w A is the limit of a sequence wj = 
PjUj/crj where a\ goes to infinity. w A satisfies Eq.(5.4.2). PjWj must also go to 

infinity. Pre and postmultiplying Eq.( 4. 3. 35) by Wj and Wj, one gets: 


0 = Vj B Aj T Wj + Vj H AjWj + Vj n RjVj - wj n PjEjPjWj + Vj“rj^PjEjPjrj i Vj 


H T, 
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Since Rj is bounded as well as PjTj^, and since wj^EjWj is positive, 
H T H 

wj Aj wj + wj AjWj must be positive as j goes to infinity. Thus, in the limit, 

2Real(A^) > 0 

and from Eq.(5.4.2), 

0 = Ei/2w A 

Thus, ( A, E^ 2 ) is not stabilizable. This is contrary to hypothesis. Thus Pr 
must remain bounded. The proof for rQ can be obtained by duality. 


2) G. Ac. K remain bounded when r. Pr and rQ remain bounded 

Pr is bounded. Hence P$ is bounded: indeed, r$ = $. This arises from the fact 

that t = — and = —I . Thus G is bounded since 

n c 

G = -E c ‘ i B T P$ 

T T 

Similarly, rQ is bounded and T r = -T, thus: 

K = -r T qc T v c - 1 

is bounded. Finally, 

A c = — T T (A — BG — KC)$ 

is obviously bounded. □ 

The full order LQG problem is such that r = I. Theorem 5.2 implies that the 
solution to the problem remains in a compact domain which, in turn, implies that 
the number of solutions to the LQG problem is constant, as long as the 
detectability and stabilizability hypotheses are met, and that the problem 
parameters remain bounded as well. As for the reduced order problem, one can 
find counterexamples of Pr^ and r Q being unbounded even though the above 
hypotheses hold. The unboundedness of P and Q always corresponds to a closed 
loop pole crossing the imaginary axis. Like the LQG problem, the reduced order 
control problem has solutions which satisfy the optimality conditions Eqs.(3.3.19- 
23) but for which P and Q are not positive, or, in other words, such that the 
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dosed loop is unstable. The full order solution guarantees that none of the 
unstable solutions will become stable and vice versa. This is not the case with 
the reduced order problem. 


5.4.4 Unboundedness of P t ± and r^Q along a Solution Path 


This section presents examples of problems for which stabilizability and 
detectability conditions are met and where P and r^Q are unbounded. 


5.4.4. 1 Example 1 

Consider the second order SISO system given by: 


C = 


[1/2+e 1/2— e] , 




along with the design cost parameters: 


R = V = 


'1 0 
0 1 . 


R c = V c = 1. 


The compensator is selected to be first order. The plant has two poles at 1 and 
+1 and a zero at -2e. Writing the compensator in Controller Canonical form, the 
gain K is set to 1. The compensator is completely defined by its pole a c and the 
control gain g which are two real numbers. The closed loop dynamic matrix is. 


Aci - 


1 0 g ' 

0 -1 g 

1/2+e 1/2— e a<;_ 


The characteristic polynomial is: 


<f{ s) = s 3 - a c s 2 - 2gs + a c - 2eg 


( 5 . 4 . 5 ) 


The polynomial admits stable roots if and only if: 
a c < 0 

g < 0 

ac > 2eg 
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Hence, £ must be positive and the system must have a minimum phase zero in 
order to be stabilizable by a first order compensator. 

Let a c o and g 0 be an optimal solution for e 0 > 0. The corresponding 
compensator stabilizes the plant since the zero of the system is minimum phase. 
Consider now closing the loop around the system where e = -e 0 with a 
compensator such that g = g 0 and a c = -a c o- Using Eq.(5.4.5), the closed loop 
characteristic polynomial for the first system is: 


^s) = s 3 - acos 3 - 2g 0 s + a c o - 2e 0 go 


and for the second system: 


<p( s) = s 3 + a c oS 3 - 2g 0 s - a c o + 2£ 0 g 0 


The two polynomials have the same coefficients for odd powers of s and 
coefficients of opposite sign for even powers of s: they admit, therefore, similar 
roots of opposite sign and the poles of the second system are the mirror images 
about the imaginary axis of the poles of the first system. If 


Po 


Pll Pl2 P 13 
P21 P22 P23 
. P31 P32 P33 


is the solution to Eq.(3.3.19) for e = £0, a c = a c o and g = go, then one can verify 
that 


Pi = 


— P 22 — P 12 P 23 

“ P21-PU P 13 
. P32 P 3 1 ~ P33 


is the solution to Eq.(3.3.19) for £ = -£ 0 , a c = -a c o, g = go- Similarly, if 


Qo 


Q 11 Q 12 q is 
Q 21 q 22 q23 
Qsi 932 q33 . 
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is the solution to Eq.(3.3.20) for the first problem, 


Qi- 


— q22 — 0. 12 q23 
— q.21 — Q 1 1 qu 
q32 Q31 “<133 . 


is the solution to Eq.(3.3.20) for the second problem. One can verify that if P 0 , 
Qo, a c o> go and ko = 1 satisfy the optimality conditions Eqs.(3.3. 19-23) for e = £o» 
Pi) Qi, h acOi go and ki = 1 satisfy Eqs.(3.3.19-23) for e — —£o- The associated 
cost Ji = Tr(QiRci) is equal to J t =-Jo. The compensator satisfies the 
optimality conditions Eqs.(3.3.19-23) but yields a completely unstable closed loop 
system. As e crosses the imaginary axis the cost becomes infinite. When the 
zero of the plant becomes nonminimum phase the cost J loses its physical 
meaning. Figure 5.4 shows the value of Tr(QRci) as a function of the zero 
location. Figure 5.5 shows the control parameters as a function of the zero 
location. 

As e goes to zero, the best a first order compensator can do is put the 
closed loop poles on the imaginary axis. The cost for such a system becomes 
infinite and P and Q are unbounded. There is no solution for e = 0 since P and 
Q are infinite, but looking at Figure 5.5, one can define a solution at e = 0 by 
continuity. Hence a stabilizing solution may continuously become nonstabilizing, 
as the system parameters are changed and the optimal path followed. The open 
loop system remains observable and controllable for all a between —0.5 and 0.5. 
The closed loop poles cannot, however, be arbitrarily assigned. 


5.4.4.2 Example 2 

In the following example, the poles of the closed loop system can be assigned 
arbitrarily. Consider the control problem defined by: 


A = 


ai 0 

0 a2. 




R = V 



Re - V c = 1, n c = I, 


Such a system is made of the aggregation of two completely separate LQG 
problems for two independent first order systems. One tries to control both 
systems optimally with a single first order compensator. 
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Tr(QRcl) 



Figure 5.4: Variation of the Optimal Cost as a Function of Zero Location 



Fi gure 5.5: Variation of fX) and g (0) as a Function of Zero Location 
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The projection has two obvious solutions: 


T 1 = 


'1 O' 

0 0. 


optimal control of the first subsystem, 
ignore the second subsystem, 


r 2 = 


0 O' 
0 1 . 


, optimal control of the second subsystem, 
ignore the first subsystem. 


All the optimality conditions can be satisfied with these choices for r. When ai 
and a 2 are both negative, both solutions yield a stable closed loop. When a t is 
positive, the solution r = r 2 , which corresponds to controlling the second 
subsystem only, becomes unstable. Similarly, if a 2 becomes unstable, t = T\ 
yields an unstable closed loop. 

Considering the solution r = r 2 , the compensator obtained in this solution 
is independent of a t . As aj becomes positive, the solution, which is constant, will 
become a nonstabilizing solution. Note, however, that as long as ai £ a 2 , the 
closed loop dyn ami cs can be assigned arbitrarily. Choosing a realization such 
that ki = k 2 = -1, the closed loop dynamic matrix becomes: 


A c 


' ai 0 gT 
0 a 2 g 2 
— 1 — 1 a c 


The characteristic polynomial is: 

V?(s) = s 3 - (ai+a^acjs 3 + (gi+g 2 +aia 2 +a c (ai+a 2 ))s -giar- g 2 aj— ata 2 a c 
Assume we want the characteristic polynomial to be: 


<p{s) = S 3 + <r 2 S 3 + (T iS + (To 

a c , gi and g 2 must then satisfy the following linear system of equations: 


+ a 2 + <r 2 


' -1 0 0' 


ac 

- aia 2 + (?\ 

= 

ai+a 2 1 1 


gi 

- 0*oj 


a ia 2 a 2 a^ 


L szj 
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the determinant of the system is equal to ar-a^ Hence, as long as the two 
subsystems do not have the same dynamics, the poles can be freely assigned using 
a first order dynamic compensator. This does not prevent the solution 
corresponding to r 2 to become an unstable closed loop solution as ai becomes 
unstable. 


5.4.5 Solutions to the Diagonal Problem 


It is claimed in [Ric87, Ric89] that all the diagonal solutions to the reduced order 
problem can be found for diagonal systems. A diagonal problem is such that: 

A = diag(ai,a 2 ,---,a n ) 


B = 


B, 

0 


Bi= diag(bi,b 2 ,* • '.bm) 


C = [Ci 0], Ci= diag(c 1 ,c 2 ,---,ci) 
R = diag(ri,r 2 ,---,r n ) 

V = diag(vi,v 2 ,---,v n ) 

R c = diag(r c i > r C 2 ,- • - .rcm) 

V c = diag(v c i ) v c2 ,--.,vci) 


The problem consists of controlling n completely decoupled first order SISO 
systems with an n c dimensional compensator. One obvious solution is to select n c 
out of the n subsystems and control them independently using first order 
controllers. The problem then reduces to solving n c independent first order LQG 
problems. The projections r associated with such solutions are diagonal: r( i, 
i) = 1 if is to be controlled, r( i, i) = 0 otherwise. Such solutions will be c all ed 
diagonal solutions. Letting n u be the number of unstable poles, one must control 
each of these modes in order to have a stable closed loop system. n c — n u modes 
can still be controlled out of n— n u remaining stable modes. If m and 1 are larger 
than n c , i.e. there are more controllable and observable subsystems than there are 
compensator modes, the number of such possible solutions corresponds to the 

combination ° u ) or 1 if the number is not defined. 

More solutions may exist, however, even for diagonal problems, as the 
following examples will show. These solutions cannot be found systematically. 
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The second order system of Section 5. 4.4.2 is considered for different pole 
locations and for different R and V matrices as well. 

First, consider the case where at = 0.0 and a 2 = +0.1. The open loop 
system has two unstable poles and cannot be stabilized with a diagonal r. A first 
order controller can however stabilize the system. The following optimal solution 
is found by direct optimization for R = V = R c = V c = I?: 

a c = -2.1530 K = [0.6736 1.3294] 


The closed loop poles are: 



' 0.6736' 

[-0.4504 -0.8082' 


—1.3294 

r “ [ 0.8082 1.4504 


A = -0.0450, -1.0038, -1.0042 


Consider now the plant poles at ai = —0.01 and a 2 = +0.1. This system 
can be obtained by continuously moving the pole ai from its previous value of 
ai = 0.0 to its new value of ai =-0.01. Using the homotopy algorithm shown in 
Section 5.3, the new solution for at = —0.01 and a 2 = 0.0 is found to be: 

K = [0.5103 -1.2412] 


ac = -2.1375 
G = 


0.5103 

1.2412 




-0.2636 -0.5771 
0.5771 1.2636 


The closed loop poles are: 

A = -0.0390, -1.0034, -1.0051 

A second solution for that particular value of at corresponds to a diagonal 
solution where a 2 is the pole being controlled. This yields: 

ac = -2.1100 K = [0 -1.0000] 


G = 


0 

1.2210 


r = 


0 ) 
0 1 


The closed loop poles are: 

A = -0.01, -1.0050, -1.0050 

Finally, we consider the case where at = —0.01 and a2 = —0.1. The 

weighting matrices R and V are now taken to be R = V = q . 

A nondiagonal solution was obtained numerically for that problem. The control 
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parameters and projection are: 


ac = -3.6802 K = [-0.7037 -1.6535] 


'0.7037' 

_ f 0.1537 

-0.3606' 

1.6535 

T ~ [—0.3606 

0.8463 


The open loop system being stable, the two diagonal solutions corresponding to t x 
and are stabilizing solutions as well. 

In summary, three examples of diagonal problems have been considered, 
one with two unstable poles, one with one stable and one unstable pole and one 
with two stable poles. In each case, it was possible to obtain solutions which are 
nondiagonal. Hence, even for simple problems, one cannot be certain to find all 
the solutions to the initial problem in a simple manner. The upper bound 
proposed in [Ric89] for the maximum number of diagonal solutions to the OPE 
underestimate the maximum number of stabilizing solutions to the problem. The 
nondiagonal solutions may also be the only one that connects to a stabilizing 
solution when all the plant poles are unstable. 


5.4.6 Critical Solutions and Bifurcations 


Solutions can appear and disappear when P and Q become infinite and a 
nonstabilizing solution becomes stabilizing and vice versa. A second mechanism 
for solutions to appear or disappear is when a critical point is encountered along 
the solution path. Following Definition 5.1, a critical point for the equation 
4>(X) = 0 is a point at which is singular. In our particular case, this means 
that the nullspace of the Hessian is not composed only of those directions 
corresponding to a change in the state space realization of the compensator. If 
one uses a minimal set of parameters, the reduced Hessian will be column rank 
deficient if the solution is a critical point. Bifurcations can then occur, as 
illustrated in the following example. 

Consider once more the second order system of Section 5.4.5 with its first 
order controller and a 2 — +0.1. Varying the first pole at, we track the diagonal 


solution corresponding to r = 


0 0 

Lo ij- 


We consider here the entire set of 


parameters a c , gi, g 2 , ki, k 2 and compute the eigenvalues of the Hessian as a 
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function of ai for the diagonal solution as ai moves toward the right half plane. 


Table 5.1: Eigenvalues of the Hessian 


a t 

Si 

s 2 ... 

S3 

sj 

BH 

-0.0300 

0.000 

2.020 

0.062 



-0.0280 

0.000 

0.094 

0.062 

3.590 

43.13 

-0.0279 

0.000 

-0.018 

0.062 

3.590 

43.39 

-0.0270 

0.000 





-0.0250 

0.000 

-4.080 

0.0621 

3.590 

52.48 


The first eigenvalue of the Hessian, Si, is always zero. It corresponds to the 
freedom in scaling the state variable representing the compensator. The 
eigenvalue s 2 is positive for a! = -0.0280 but becomes negative for ai = -0.0279. 
The solution starts out as a local minimum but then becomes a saddle point. 
The critical solution occurs for a value of ai c = -0.02791583. Considering the 
nondiagonal solution found in the previous section for ai = -0.010 and 
integrating backward (i.e. reducing ai), one finds that the solution merges with 
the diagonal solution at ai = a Jc . The corresponding derivatives of gi and ^ with 
respect to ai become infinite. Figure 5.6 shows a plot of the control parameters 
as a function of ai and clearly shows the bifurcation occurring at ai = ai c . Figure 
5.6a shows the values of G(l) and G(2) as a function of at. The diagonal solution 
corresponds to the optimal control of the second subsystem: for this solution 
G(l) = 0 and G(2) is constant since the diagonal solution is independent from ai. 
As ai comes closer to zero the second solution appears. The corresponding G(l) 
is not zero anymore and G(2) varies as well since the solution couples both of the 
system modes and the variation of ai influences now G(2). Figure 5.6b shows the 
variations of K(l) and K(2) as a function of a,, Figure 5.6c shows the variations 
of a c . The behavior of a c and K is similar to that of G. Figure 5.6d shows the 
optimal cost for each solution. The cost of the diagonal solution rapidly increases 
as ai moves toward the right half plane and the closed loop system becomes 
unstable. 
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5.4.7 Multiple Local Minima 


The following example shows multiple stabilizing solutions and, in particular, the 
occurrence of multiple local minima. The number of sensors and actuators is 
strictly smaller than the order of the compensator in this example, unlike the 
examples of multiple solutionipreviously shown. Consider the fourth order SISO 
system: 


'0100 


' 0 ' 

-1-0.1 0 0 

, B = 

1— a 

0 0 0 1 

0 

0 0 -2 -0 . 1 


a 


C =[ 1 0 1 0 ] 

Take the LQG parameters to be: 

R = V = I 4 , 

Rc = V c = 1 


A second order compensator is sought for the problem (n c = 2). A solution So is 
found numerically for a = 0 and a solution Si is found numerically for q — 1. 
The solution So is integrated from a = 0 forward and the solution Si is integrated 
from q = l backward. For a = 0.055 two solutions are found. From the forward 
integration, one gets: 


Ac 


'-0.6905 0.4230' 
-1.3465 — 0.6744 J ' 



G = [ 0.0621 -0.5307] , 


J = 29.3008 


The eigenvalues of the corresponding Hessian are: 


46.6288, 13.6840, 1.7978, 0.0771, 0.0, 0.0, 0.0, 0.0, 


From the backward integration one gets the following solution: 


Ac 


'-2.2471 -0.9574' 
-1.5384 -2.1382 ’ 


K = 


1.2721 

0.1405 


G = [—0.1802 0.1405], 


J = 29.3030 
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The eigenvalues of the corresponding Hessian are: 


47.7989, 5.8213, 0.3235, 0.0015, 0.0, 0.0, 0.0, 0.0 

Each Hessian has four zero eigenvalues that correspond to the freedom in 
selecting the state space representation of a second order transfer function. 
Notice also that the fourth eigenvalue becomes very small in both cases. Both 
solutions obtained are local minima. 

As a is increased, the solution So encounters a critical point and becomes 
a saddle point, even though it still is a stabilizing compensator. Similarly, as a is 
decreased the solution S i encounters a critical point and becomes a saddle point. 
At a = 0.055, two local minima exist. The open loop system is controllable, 
observable and stable. Hence, the number of solutions to the OPE exceeds the 
upper bound given in [Ric87], even if only the minima are considered. Table 5.2 
summarizes the characteristics of the two compensators for a — 0.055. 


Table 5.2: Compensator Characteristics, a = 0.055 



Forward Solution 

Backward Solution 

Closed-loop 

Poles 

-0.4769 ± j 0.5188 
-0.2509 * j 1.0592 
-0.0546 ± j 1.4135 

-3.4983 

-0.4864 

-0.2450 ± j 1.0053 
-0.0554 ± j 1.4128 

Compensator Poles 

-0.6825 * j 0.7547 

-0.9778 

-3.4075 

Compensator Zero 

-5.2212 

3.8647 


Even though the optimal costs are very close, the compensators are of very 
different natures. The first one is minimum phase and has two oscillatory poles 
close to the first mode of the system. The second compensator has a 
nonminimum phase zero, one slow real pole and one fast real pole. As a changes, 
one can vary each compensator in order to leave the cost stationary but, as a is 
varied, one compensator structure ceases to yield a minimum. 
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5.4.8 Accommodating Critical Points: Software Modification 

Looking at the example of Section 5.4.6, one can see that the Hessian matrix has 
two eigenvalues equal to zero at the critical value a! = a*. One of the 
eigenvalues is the predicted singularity, the second one however characterizes the 
critical solution. The derivatives of the control parameters with respect to a t are 
not well defined at that particular solution. When ai is smaller than ai C , the 
diagonal solution corresponds to a local minimum. When ai is larger than a lc , 
however, the diagonal solution is a saddle point and the nondiagonal solution is 
the local minimum. If one tries to track the optimal solution as a i is varied from 
the left to the right of its critical value, one can detect the proximity of the 
critical point by checking the rank of the Hessian. One can then decide not to 
rely on the gradient £ Q which may be ill-conditioned or not defined at all, and 
simply increment the value of aj. The minimization step should then find the 
solution corresponding to the local minimum and abandon the diagonal solution 
to follow the nondiagonal solution. The solution becomes noncontinuous but 
remains valid for all values of a t . More generally, The modification to the 
shooting step is the following: 

Step 2.1 : Compute L f * 

Step 2.2 : If L has exactly Nd-N m zero eigenvalues, compute £ ak 

Else, set £ = 0 

N d -N m is the number of extra degrees of freedom left in Whenever a critical 
point is encountered along the solution path, the shooting step does not rely on 
the gradient £ Q anymore, for may be ill-conditioned or may not exist at all. 
In that case, one simply increments the homotopy parameter a and relies on the 
minimization routine to find the solution corresponding to a minimum. The 
procedure guarantees the convergence toward a minimum. 
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5.4.9 Conclusion 


The optimality conditions for the LQG problem have multiple algebraic 
solutions. When the form of the controller is not constrained, the problem has 
the property that only one of the solutions stabilizes the plant and corresponds to 
a minimum for the cost. When the order of the compensator is reduced, however, 
this section has shown that the property is not valid anymore. Multiple 
stabilizing solutions can occur, corresponding to local minima or saddle points for 
the cost. Similarly, cases occur where no stabilizing solution exists. The section 
has also shown that the nature of a solution is not invariant under homotopy: 
minima can become saddles, stabilizing solutions can become nonstabilizing. 
These changes occur, however, in a smooth continuous fashion. All solutions, 
stabilizing, nonstabilizing, minima, saddle points cannot be obtained in any 
systematic manner even for simple problems like diagonal problems. Hence, the 
homotopy procedure will be guaranteed to track the global optimum only locally. 
Any global results require the tracking of ill solutions. 
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5.5 PRACTICAL APPLICATION OF THE CONTINUATION METHOD 


5.5.1 General 

We consider in this section a practical application to illustrate the numerical 
problems that can arise when using a continuation method. The example is 
drawn from [Ber87b]. The system to control is made of a pair of simply 
supported Euler-Bemoulli beams connected by a spring. The system is depicted 
in Figure 5.7. Each beam has one rate sensor and one force actuator. Two 
vibrational modes are retained to describe each beam and the state space 
representation of the system is an eighth order interconnected model. The 
expression for the A, B and C matrices have been derived in [Ber87bj. There are: 


where 


a _ [An A 12 
I.A21 A22. 


Bi= 


B n 
.0 4 it 


,b 2 = 



Ci = [C„ 0 1 *4] , C2 = [0i«4 C22] 


Aii = 


(5.5.1) 


0 uj 1 i 0 0 

n 

— wii-(k/u;i i) (sinxc i) -2< iu>n -(k/u> 2 i) (sinwci) (sin27rc i) 0 

0 0 0 u) 2 i 

9 

-(k/a/ii)(sin7TCi)(sin27rCi) 0 — t^ 2 i~ (k/tx /2 i) (sin27rc i) -2£iu/2i 

Aij = 

0 0 0 0 ‘ 

(k/wij)(sin7rCi)(sin7TCj) 0 (k/a;2j)(sin7rci)(sin27rcj) 0 

0 0 0 0 

(k/a; 1 j)(sin7rc j )(sin27TCi) 0 (k/w2j)(sin27rci)(sin27r c j) 0 
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0 

-Sinara i 

B ii = , Cii = [ 0 sin7TSi 0 sin27rei] 

0 

-sin27rai 

where u/ij and Cij are respectively the j th modal frequency and damping ratio of 
the i th beam, k is the spring constant, Ci is the position of the spring attachment, 
aj the actuator location and Si the sensor location on the i th beam, all distances 
being non dimensionalized by the beam length. 
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The parameters quoted in [Ber87b] are: 


wa = 1 rad/sec, W 2 i = 4 rad/sec, Ci = 0.0050 
a! = 0.3, Si = 0.65, Ci = 0.6 
a 2 = 0.8, s 2 = 0.2, c 2 = 0.4 

The penalty on the states is given by: 


R = blockdiag 


1 0 
0 l/wu 


'1 0 


’1 0 

_0 

j 

_0 l / u /12 


T 0 
0 l/u/ 22 


V = blockdiag 


'0 O ' 


'0 

o ' 


'0 

o ' 


'0 

o ' 


0 1 . 

> 

i 

_0 

1 

> 

0 

1 

) 

_0 

1 



Rc = 0.1I 2 , V c = 0.1I 2 


(5.5.2) 


The controller consists of two decentralized 4th order compensators, each of 
which uses the sensor and the actuator of one beam only. 


5.5.2 Sequential Design 

The optimization technique used in [Ber87b] consists of sequentially optimizing 
each compensator while the design of the remaining compensator is frozen and 
the corresponding loop is closed. The compensator that is optimized becomes at 
each step the optimal reduced order compensator for the system consisting of the 
original plant with the remaining compensator loops closed. The initial 
controllers are chosen to be the controllers obtained when the interconnection is 
ignored, i.e. when k = 0, in which case the problem decouples into two 
independent 4th order LQG problems. The results were reproduced using only 
the minimization part of the algorithm developed in Section 5.3.2 which yielded 
very satisfactory results in that case. Table 5.3 summarizes the results. 


161 



Table 5.3: Cost during Sequenti al Optimization 


Design 

Cost 

Open Loop 

163.2969 

Full-Order LQG 

11.0795 

Subopt imal Decentralized 


assuming k = 0 

29.4544 

Redesign Subcontroller 1 

14.5104 

Redesign Subcontroller 2 

12.4934 

Redesign Subcontroller 1 

12.0204 

Redesign Subcontroller 2 

11.9641 

Redesign Subcontroller 1 

11.9501 

Redesign Subcontroller 2 

11.9465 

Redesign Subcontroller 1 

11.9455 

Redesign Subcontroller 2 

11.9452 


Note that there is a discrepancy between these results and those of [Ber87b] even 
for the full order LQG design. We attribute this to a mismatch between the 
parameters and the results quoted in the paper. The conclusions and basic 
behavior of the design procedure shown in the paper remain valid, however. 
Checking the optimality conditions simultaneously including both controllers, 
one finds that the error is equal to 3.9 10-3 after eighth redesigns. The cost, 
however, coincides already with the optimal cost to the first five significant 
figures. 


5.5.3 Using Homotopy: a Continuous Solution Path 

The two beams treated in the example are identical and the attachment points of 
the spring are symmetric with respect to the middle of each beam since Ci = 0.40 
(40% of the length from the left of the first beam) and c 2 = 0.60 (60% of the 
length from the left of the second beam). The interconnected system possesses 
therefore two modes which are independent of k, the first one at u = 1 rad/sec 
corresponding to the first bending modes of the beams oscillating in phase and 
the second one at oj = 4 rad/sec corresponding to the second bending modes of 
the beams oscillating with opposite phase so that the spring is not stretched at 
any time. The remaining modes of the interconnected system depend strongly on 
the value of k. We try to use this property in order to find a simpler problem as 
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a starting point. Transforming the system Eq. (5.5.1) in modal form and 
transforming accordingly the design parameters of Eq.(5.5.2), the terminal 


parameter values to use in the homotopy are: 


Ai = 


B ,= 


'- 0.0050 1.0000 
- 1.0000 - 0.0050 
0 0 

0 0 

0 0 

0 0 

0 0 

0 0 


0 

0 


0 0 
0 0 
- 0.0200 3.9999 0 

- 3.9999 - 0.0200 0 

0 0 — 0 . 0112 

0 0 

0 0 


0 
0 
0 
0 

3.1077 
-3.1077 -0.0112 
0 0 


0 
0 
0 
0 
0 
0 

-0.0138 


0 

0 

0 

0 

0 

0 

5.6870 


0 


- 5.6870 - 0.0138 


0.0001 - 0.4523 0.0044 - 0.5316 - 0.0009 0.3443 0.1020 - 0.0035 
0.0001 - 0.3286 0.0044 - 0.5316 0.0008 - 0.2970 - 0.1730 0.0040 


r r -0 0041 0 . 7969 0 . 0096 - 0 . 7236 
tl= - 0.0027 0.5257 0.0113 - 0.8506 


0.0060 - 0.2850 1.1992 - 0 . 0116 ' 
- 0.0023 - 0.2934 - 1.1118 0.0096 


Ri = 


1.6001 - 0.0080 0 0 

- 0.0080 1.6000 0 0 


0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 


0 

0 

0 

0 


0 

0 

0 

0 


0 

0 

0 

0 


0 

0 

0 

0 


1.6001 0.0080 
0.0080 0.4001 
0 0 4 . 7962 - 0 . 0298 - 0 . 0002 - 1 . 5047 

0 0 - 0.0298 4.4039 - 1.3293 0.0221 

0 0 - 0.0002 - 1.3293 1.1356 - 0.0078 

0 0 - 1.5047 0.0221 - 0.0078 0.6103 


Vi = 


' 0.0000 - 0.0001 
- 0.0001 0.6250 


0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 


0 0 

0 0 

0.0000 - 0.0052 
- 0.0052 0.6249 


0 

0 

0 

0 


0 

0 

0 

0 


0 0 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 

0 . 0000 - 0 . 0003 - 0 . 0006 0 . 0000 
— 0.0003 0.1563 0.0000 - 0.0010 
- 0.0006 0.0000 0.4946 - 0.0057 
0.0000 - 0.0010 - 0.0057 0.0001 


Bci - 


ro.i o i 

V 

* — 
o 

tH 

O 

i — 

o 

o 
1 — L 

, Vci - 

0 0.1. 


In order to get a simple initial solution, we need an initial problem that decouples 
into two fourth order LQG problems. Looking at the modal form of the problem, 
one can see that the only coupling comes from Bi and Cj. In order to split the 
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system into two subsystems we choose the following initial par am eters: 


B 0 = 


0.0001 -0.4523 0.0044 -0.5316 0 0 0 0 

0 0 0 0 0.0008 -0.2970 -0.1730 0.0040 


Co = 


-0.0041 0.7969 0.0096 -0.7236 0 0 0 0 

.0 0 0 0 -0.0023 -0.2934 -1.1118 0.0096 


A 0 = Ai 

Ro = Rj 

V 0 = V, 
Rco = Rci 
V c0 = Vci 


The parameters are then continuously deformed following Eqs.(5.2.1-7) and the 
initial solution is integrated forward as a function of the homotopy parameter a. 
Table 5.4 summarizes the steps of the integration. 

The shooting accuracy £2 is set initially to 0.1 . When the number of 
minimization steps is less than 6 the shooting accuracy is doubled in order to 
take larger steps. This strategy allows for large shooting steps. The accuracy on 
the solution during the integration has been set to e 0 = 10 Far better 
accuracies are attained, however. This is due to the fact that one extra iteration 
during the minimization process can bring the error down by 2 or 3 orders of 
magnitude especially if one is within the quadratic convergence region. The 
optimal cost J vanes very smoothly as a function of at which explains the success 
of the homotopy. The controllers obtained at a = 1 are given in Appendix C. 
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0.609766 


0.703516 


0.797266 


0.903696 


1.000000 


0.40 10-° 
0.67 10-4 


0.37 10*o 
0.19 10-8 


0.40 10-o 
0.91 lO* 7 


0.14 10*0 
0.18 10-8 


11.5967 

11.5512 


11.7248 

11.7072 


11.8683 

11.8529 


11.9534 

11.9450 





















5.5.4 Using Homotopy: a Discontinuous Solution Path 


The system formed by the two beams is naturally decoupled when the stiffness of 
the interconnecting spring is zero, or in other words when the spring is removed. 
A very natural approach is to continuously increase the stiffness of the spring 
from k = 0 to k = 10. If one looks at the form of A in Eq.(5.5.1), one can see 
that it can be written as: 

A = A 0 + kAA 

where, for the particular parameters chosen, 



0 

1.0000 0 

0 

0 

0 

0 

0 

1.0000 

- 0.0100 0 

0 

0 

0 

0 

0 

0 

0 0 

4.0000 
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0 

0 

0 

0 
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0 

0 

0 

0 

0 

0 0 

0 

0 

1.0000 

0 

0 

0 

0 0 

0 

- 1.0000 - 0.0100 

0 

0 

0 

0 0 

0 

0 

0 

0 

4.0000 

0 

0 0 

0 

0 

0 

- 4.0000 - 0.0400 



0 

0 

0 

0 

0 

0 

0 

O ' 


- 9.0451 

0 

1.3975 

0 

9.0451 

0 

1.3975 

0 


0 

0 

0 

0 

0 

0 

0 

0 

A * - 

5.5902 

0 

- 0.8637 

0 

- 5.5902 

0 

- 0.8637 

0 

LA A — 

0 

0 

0 

0 

0 

0 

0 

0 


9.0451 

0 

- 1.3975 

0 

- 9.0451 

0 

- 1.3975 

0 


0 

0 

0 

0 

0 

0 

0 

0 


5.5902 

0 

- 0.8637 

0 

- 5.5902 

0 

- 0.8637 

0 


The homotopy parameter a defined in Section 5.2.1 simply becomes k/10, where 
k is the stiffness of the currently deformed system. The remaining parameters of 
the problem B, C, R, V, Rc and V c need not be changed since they naturally 
have the correct block diagonal structure. 

The initial compensators are the two fourth order LQG solution to the 
problem with k = 0. Freezing the initial controllers and varying the stiffness of 
the spring, one finds that they stabilize the system for 0 < k < 2.8395 and k > 
7.7310 . They do provide a stabilizing solution for k = 10 and constitute the 
starting point of the sequential design of [Ber87b]. However, the closed loop 
system is unstable whenever 2.8395 < k < 7.7310 and the initial controllers are 
used. This indicates that the solution has a different character for small and 
large k. Starting the homotopy at a = 0 with the initial decentralized solution 
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one does indeed encounter a critical point at a — 0.5724, or k = 5.724. At that 
point the algorithm cannot keep tracking the solution. The minimization step 
converges instead toward a very different solution. This step consumes most of 
the run time since the minimization starts with an initial solution that may be 
quite different in character to the minimum. Once the software has found a new 
local minimum, it can resume the forward integration starting with the new 
solution. As k reaches 10 the solution obtained is the same as the one found in 
the previous subsection using a different initial simplified problem. The solution 
at k = 10 was subsequently used as a starting point in order to do the homotopy 
backward and reduce the spring constant from 10 to 0. We will call the forward 
path the path of solutions obtained from the decoupled solution at k = 0 as k is 
increased and the backward path the path of solutions starting at k = 10 as k is 
decreased. As k keeps decreasing, the backward path also encounters a critical 
point: the integration cannot go pass k = 1.795 and the minimization then 

converges on the solution that is on the forward path. There is a whole range of 
values for k, between 1.795 and 5.724, where the system admits multiple 
solutions. The two solutions obtained for a = 0.57 ( k = 5.7) are as follows: 

rnmppnsators Dynamics from Forward I ntegration 



0 100 


'0" 

A c i = 

0010 

0001 

,Ki = 

0 

0 


-70.2930 -287.3375 -79.1406 -11.2272 


1 

Gi= [-16.8490 525.6644 -24.1238 27.0323] 




0 1 0 0 


'o' 

Ac2 = 

0 0 10 
0001 

,k 2 = 

0 

0 


—23.9153 -228.7647 -64.7072 -11.8874 


1 

G2 = 

[-48.5721 27.0888 -66.0029 1.1453] 




p _ Gi 0 i«4 

0 1 14 G 2 


K = 


K 1 0 4 11 
0 4 n K2 


Cost J = 10.4692 
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Compensators Dynamics from Minimization 


0 

1 

0 
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‘O' 
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0 
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0 


0 

0 

0 

0 
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, hi - 
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-110.3980 

-297.0714 -80.6289 

-11.4036 
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G t = [ 36.6532 518.1627 -21.6314 26.7397] 



0 

i 

0 

0 


'o' 

Ac2 = 

0 

0 

0 

0 

1 

0 

0 

1 

II 

« 

** 

0 

0 


—8.1725 

-20.2980 -28.1007 

-3.5422 


1 


G 2 = [-12.0068 9.7086 -12.1283 -3.3435] 


G = 


G t 
0 li4 


0 1.4 

G 2 


K = 


Kj 0 4 ,i 

[0 4 il Kj . 


Cost J = 10.4459 


The compensators are written in Controller Canonical form for easier 
comparison. The parameters are quite far apart between the two solutions. Both 
solutions satisfy the optimality conditions with an accuracy better than 10' 1 °. 
They yield a stable closed loop system implying that the matrices P and Q are 
non negative and correspond to minima. Figure 5.8 compares the closed loop 
poles obtained with the two different solutions. 

Table 5.5 summarizes the results of the forward and backward 
integrations. The solution is unique at k = 0 and also appears to be unique at 
k = 10, as only one solution was found using either homotopy or direct 
minimization. Appendix C regroups the controllers obtained for various values of 
k in the forward or the backward integration. 
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Figure 5.8: Comparison of the Closed Loop f or k = 5.7 
«: Forward and *: Backward Integration 
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Table 5.5: C ost on For ward and Backward Intention 


a 

Forward 

Integration 

Cost 

Backward 

Integration 

Cost 

0.0000 

7.8926 

* * 
• 

0.1000 

7.7483 

* * 
• 

0.1800 

8.0781 

8.1654 

0.2000 

8.1816 

8.2587 

0.3000 

8.7914 

8.8221 

0.4000 

9.4692 

9.4779 

0.5000 

10.0875 

10.0787 

0.5700 

10.4692 

10.4459 

0.5724 

10.4816 

10.4581 

0.6000 

* . * 

10.5959 

0.7000 

* o * 

11.0844 

0.8000 

*. * 

11.5486 

0.9000 

* * 

11.8875 

1.0000 

* * 

11.9450 


5.5.5 Dicussion 

When the stiffness of the spring is large enough, one can recognize two types of 
modes in the composite system. The first type can be qualified as "group 
modes". It corresponds to the displacement in phase of the two beams in such a 
way that the spring is never elongated. This is made possible by the fact that 
both beams have similar dynamics. The second type of modes can be qualified as 
"spring modes". It corresponds to the motion of the two beams that will 
elongate the spring. When the spring stiffness is low, the dynamics of the 
composite system consist also of two types of modes. The first type, in that case, 
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is associated with the motion of the first beam, and the second one to that of the 
second beam. The nature of the control obtained for small values of k 
corresponds mostly to the control of the beam modes since the only solution is a 
continuous deformation of the uncoupled solution obtained at k = 0. For large 
values of k, however, the control separates into the control of the spring the 
group modes since it is found by continuously deforming the compensator 
obtained by assuming that the sensors and actuators are such that group and 
spring modes can be estimated and controlled separately, while the stiffness k is 
unchanged, k = 10 (Section 5.5.3). For intermediate values of k, the situation is 
not clear and two types of control subsist, one connecting to the independent 
beam control at k = 0 and one connecting to the spring and group mode control 
at k = 10. The homotopy provides some insight in the physical meaning of the 
controller even when the nature is harder to identify. It appears that the initial 
problem must have a controUer of the same nature as the final problem if one 
wants to track the solution. There may be more than one stabilizing 
compensator corresponding to a local minimum, which would mean that one has 
not identified the right architecture for the controller. 


5.6 CONCLUSION 

Continuation methods are reported more successful at solving complex control 
design problems than the direct optimization methods [Ric87, Hyl90]. A 
continuation algorithm has been derived in this chapter in order to solve the 
fixed architecture H 2 Optimal Control Problem. The algorithm combines a 
simple integration scheme with a minimization routine in order to control the 
error of the solution. The minimization scheme uses modified gradient steps 
along with modified Newton-Raphson steps. The modifications of the 
minimization methods are necessary in order to deal with the singularity of the 
problem since it admits families of solutions corresponding to the different state 

space realizations of the same transfer function. 

A central issue in the use of homotopy is to determine the number of 
connecting solution paths between two problems as well as the possibility to find 
all solutions to simpler problems. It was found in this chapter that there is no 
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systematic way to find all solutions to the constrained LQG problem even for 
diagonal problems. It was also found that the control problem admits multiple 
solutions of various natures. Some solutions correspond to nonstabilizing 
controllers while others yield a stable closed loop. Among the stabilizing 
solutions, some correspond to minima whereas others are saddles. Unfortunately, 
the nature of a solution is not invariant along a solution path: minima can 
become saddles and stabilizing solutions can continuously become nonstabilizing 
controllers. One must, therefore, determine all solutions, and not only the 
minima, and track all of them in order to have a global tool for solving the 
contrained LQG problem. One alternative is to rely on a minimization routine 
and follow noncontinuous solution paths when a critical point is found along the 
way. The success of the homotopy will strongly depend on how close the initial 
and the final problems are related. Take, for example, a system consisting of p 
weakly coupled subsystems. A natural architecture for that problem is to control 
each subsystem independently. A good starting solution can be obtained by 
setting the coupling terms to zero and to solve p independent LQG or reduced 
order LQG problems. One can then interpret the homotopy parameter a as 
being some norm of the coupling terms. Of course, if one keeps increasing the 
coupling terms to a point where the subsystems become strongly coupled, the 
decoupled solution does not bear any of the characteristics of the solution 
corresponding to the strongly coupled solution and one might expect the weak 
solution to vanish and a bifurcation to occur. A clear example of such an 
occurrence was demonstrated using an increasingly coupled set of beams 
controlled independently. Similarly, if the noise and the penalty matrices tend to 
couple the subsystems, one can expect to encounter difficulties in following the 
solution. 

The algorithm can accommodate critical points along the solution path 
and track solutions corresponding to minima. This property was also 
demonstrated on the coupled beam problem. However, the algorithm can still 
fail to find a solution, whether it is because there is no solution, or because one 
has not found a path that connects to it. The selection of the architecture will 
play an important role for the success of the solution algorithm. 
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EXAMPLES OF 

FIXED ARCHITECTURE DESIGNS 


6.1 INTRODUCTION 


Some solutions to the fixed architecture problems have been already shown, 
which have been obtained with the numerical algorithm presented in Chapter 5. 
A broader validation is proposed in this chapter and consists of deriving reduced 
order compensators for the four disk drive system of Enns [Enn84]. This example 
was used in [Liu86] as a testbed for different compensator order reduction 
techniques, and it was also used in [Ric87, Hyl90] to validate the Optimal 
Projection Equations approach to find reduced order controllers. Enns’ system is 
a flexible shaft supporting four dissimilar disks. A torque is applied to the first 
disk while the motion of the third disk is measured. Such a system is unstable 
and nonminimum phase. Reduced order controllers of order 2 to 6 are to be 
generated for increasing level of disturbance noise affecting the plant. 

Once the confidence in the software abilities has been raised, more 
realistic problems involving decentralized controllers can be tried. Two lightly 
damped flexible structures were selected to provide a testbed for the design 
method. Both are fully instrumented experimental articles developed at the 
NASA Langley Research Center. Models, as well as specifications for the 
hardware components were available for both systems. The designs were, 
therefore, based on actual performance considerations and took into account 
hardware limitations such as maximum actuator authorities and noise levels, all 
given by the component specifications. The first experiment is the Mini-Mast, a 
20 meter long truss structure which has been manufactured and assembled with 
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space flight tolerances. The mast has a triangular section inscribed in a 1.4 
meter diameter circle and is cantilevered at its base. Three torque wheels serve 
as the principal actuators at the top of the structure. Noncontacting sensors 
monitor the displacement of the truss vertices. The structure is an ideal testbed 
for performing vibration suppression experiments. 

The second experiment is the SCOLE, or Spacecraft Control Laboratory 
Experiment. The article duplicates the dynamics of a composite satellite made of 
a large mass/inertia module (i.e the space shuttle) connected to a small 
mass/inertia module (i.e an antenna reflector) by a long flexible mast. The 
shuttle is simulated by a 500 pounds steel plate with appropriately scaled 
moments of inertia and is suspended by a single cable mounted to a universal 
joint near the center of gravity of the system. The reflector is connected to the 
shuttle by a stainless steel, 120 inch long tube and hangs down in order to reduce 
unnecessary loads. The reflector is a 24 inch side hexagon and is positioned 
horizontally in a nonsymmetric fashion relative to the shuttle. The reflector and 
mass both weigh around 5 pounds with no sensor and no actuator. Aircraft 
quality rate sensors and accelerometers are located both on the shuttle and on the 
reflector. The Line of Sight (LOS) pointing of the reflector is the typical control 
problem to investigate, where the flexibility and mass /inertia mismatch will 
naturally lead to problems of control/structure interaction. 

The models used in the examples capture the main features of the systems 
they describe even though they may not represent the most current 
configurations of the experiments. The fixed architecture controllers obtained in 
the chapter will realistically illustrate the benefits and shortfalls of the approach. 
Designs will be compared to the unconstrained full order controllers in order to 
understand the implication of reducing the order and constraining the 
information flow. 
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6.2 DIRECT METHOD VERSUS INDIRECT METHOD: ENNS’ EXAMPLE 


6.2.1 Enns Four Disk Drive 

The four disk system considered by Enns is an experiment originally developed it 
Stanford University [Enn84]. Its purpose was to study robust control designs. 
The four disk drive consists of a shaft whose torsional stiffness is small enough so 
that the system has slow lightly damped oscillatory poles. The control is 
performed by a torque motor connected to the first disk while a tachometer 
measures the rotation of the third disk. The system can be modeled with an 
eighth order transfer function. The transfer function has two poles at the origin 
if one assumes the shaft to be perfectly balanced and the bearings to be 
frictionless. The plant is therefore unstable and, because the sensor and the 
actuator are not collocated, it also happens to be nonminimum phase. Its 
nominal transfer function is: 

0. 01(0. 64s 5 +0. 235s 4 +7. 13s 3 +100. 02s J +10.45s+99. 55) 

G ( s ) * — 

52(56+0. 16 Is® +6. 004s * *0 . 5822 s 3 +9 . 985s 3 +0 . 4073S+3 .982) 


The uncertainty in the plant is introduced by allowing some mismatch between 
the inertia of the disks. Stability was found to be guaranteed as long as the loop 
transfer function had a shape contained in a region shown in Figure 6.1 [Enn84|. 
The loop transfer function properties can be obtained by using a full order LQG 
compensator when the problem parameters are properly chosen. The work 
undertook by Enns was to reduce the order of the full order controllers found to 
meet the robustness constraints with a compensator reduction technique of his 
own. The work presented in [Liu86] was to extend the comparison and, 
considering the same full order controllers, reduce their order using various order 
reduction techniques, including a method of their own. Such order reduction 
methods are indirect since the design procedure always consists of finding a full 
order controller first, and then reducing it to meet the order constraints. Indirect 
methods are shown to fail to stabilize the plant in many cases [Liu86], especially 
when the disturbance entering the plant is high. 
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[Ric87, Hyl90], on the other hand, consider the LQG problems that 
generate the full order compensators that meet the robustness requirements and 
directly finds the reduced order controllers that solve the optimization problem. 
Direct methods were found to provide stabilizing compensators in all cases and 
the designs were extended to cases with much higher levels of disturbances 
entering the plant. The same reduced order LQG problems are to be solved with 
the newly developed software. 



Figure 6.1: Admissible Region for the Loop Transfer Function 

in Enns’ Example. 
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6.2.2 The LQG Problem 


The nominal plant model corresponds to the four disks having the same inertias. 
Given the transfer function G(s) given in 6.2.1, a state space model can be 
derived. The Observer Canonical Form is chosen in [Liu86]. The A, B and C 
matrices are: 
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The plant poles and zeros are: 

Poles 

0.0000 

0.0000 


Zeros 

2.2616 ± j 5.1916 
-0.0199 ± j 0.9998 


-0.0153 * j 0.7648 -4.8506 

-0.0282 = j 1.4097 
-0.0370 ± j 1.8496 


The controlled output z is given by z = Hx, where H is: 
H = [0 0 0 0 0.55 11 1.32 18] 


The penalty on the control is one. The quadratic cost is given by R and R c 
respectively equal to: 

R = qi H T H, qj = 10* 6 
Rc= 1 

The disturbance noise is modeled as a white noise being added to the control 
signal and the measurement noise has intensity one. V and Vc are therefore. 

V =q 2 BB T 

V c — 1 


177 



The robustness guarantees were shown to exist with the full order LQG 
compensator for values of q 2 ranging from 10* 3 to 10® [Enn84]. Reduced order 
LQG problems of various orders have been derived for q 2 between 10* 3 and 2000 
by [Liu86], and between 10 * a and 10 5 by [Ric87, Hyl90]. 


6.2.3 Numerical Results using Homotopy 
6.2.3. 1 Results Summary 

The extent of this present comparison is to design reduced order compensator for 
n c between 2 and 6 and q 2 equal to 10J, j = -2 to 5. Table 6.1 contains the value 
of J/q 2 for different compensator orders and different q 2 . 


Table 6.1: Values J/o? with Optimal Compensators of Increasing Order 


m 

2 

3 

4 

5 

6 

8 

o 

1 

to 

.2270*400 

.22708397 

.22708050 

.22708050 

.22708044 

.27080394 

10-1 

.16709687 

.16707101 

.16678943 

. 16678943 

. 16677428 

.16677295 

10° 

. 14673280 

.14593113 

.14378364 

. 14378357 

. 14335087 

.14330784 

10 1 

.14293114 

.14028275 

.13662988 

. 13662986 

.13369265 

.13336824 

10 3 

.14249519 

.13868584 

.13505833 

. 13504924 

.12819751 

.12727027 

103 

. 14245084 

.13818969 

.13475189 

.13471420 

.12432746 

1 

.12280585 i 

10< 

.14244639 

.13803300 

.13470714 

.13465987 

.12199848 

.11923043 

105 

. 14244595 

.13798344 

.13470227 

.13465367 

.12064334 

.11618572 
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Figure 6.2 shows the curves J/q 2 for the different compensator orders as a 
function of q 2 - The curve allows an easy comparison with the results of [Ric87, 
Hyl90] and shows a close match except maybe for n c = 5. 
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6.2.3.2 Convergence Properties 

All designs were started at q 2 = 10-2. For each value of n c the LQG problem was 
transformed into a suitable diagonal problem and the compensator was tracked 
using the homotopy procedure of Chapter 5. Once the compensator for q 2 = 10 -2 
was found, q 2 was increased, in powers of ten, to the various desired values while 
the solution just obtained was being tracked. The new solution was then used as 
a new starting point and q 2 increased again. 

The open loop system is both unstable and nonminimum phase. The best 
achievable performance is therefore limited, and it is not possible to obtain zero 
error even with a full order LQG regulator [Kwa72a]. Consequently, the cost is 
insensitive to variation in compensator parameters once a good stabilizing 
compensator is found and when the variations only tend to improve the cost. 
The cost is, however, extremely sensitive to variations in the compensator 
parameters that reduce the stability margins. The problem is, therefore, badly 
conditioned, and the use of minimization steps encounters difficulties for large 
values of q 2 . Second, fourth and fifth order compensators were obtained with no 
particular numerical difficulties. The fifth order compensators turn out to be 
very close to their fourth order counterparts. The loop transfer functions from 
compensator input to plant output are plotted for n c = 4 and n c = 5 and q 2 = 1 
on Figure 6.3a, and for nc = 4 and n c = 5 and q 2 = 10« on Figure 6.3b. For any 
given q 2 , the fifth order compensator has four poles and three zeros which are 
almost the same as that of the fourth order, plus a pole and a zero which almost 
but not exactly cancel (Table 6.2). Such a compensator was found to be a 
minimum for the cost: the eigenvalues of the Hessian calculated for n c = 5 and q 2 
= 1 split into two groups, the first one containing ten positive eigenvalues 
between +3.5250 10 M and +1.6573 10* 5 , and the second group containing thirteen 
positive or negative eigenvalues whose magnitude is below 5.2371 10 - 9 (Figure 
6.4). The tridiagonal realization of the fifth order SISO compensator requires 
twenty three parameters, a minimal set requiring ten only: one can see that the 
Hessian has a nullspace of appropriate dimension, and one can also see that the 
condition of the problem is bad, with a factor of 10 * 9 between the highest nonzero 
eigenvalue and the smallest nonzero eigenvalue. 
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magnitude in dB 



Figure 6.3a: Loop Transfer Func tion, a? = 1 
— nr- = 4. : nr = 5 



Figure 6.3b: Loop Transfer Function , a? = 10 4 
— : = 4, : = 5 
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Figure 6.4: Magnitude of the Eigenvalues of the Hessian 
for = 5 and q-> = 1 


182 



Tahle 6.2: Compensators Poles and Zeros. 4th order vs 5th Qrdgr 


q 2 = 1 

n c = 4 

flc - 5 

Compensator Poles 

-0.4005 * j 0.3254 
-0.0649 ± j 0.8089 

-0.3999 * j 0.3254 
-0.0650 ± j 0.8090 
-0.0282 

Compensator Zeros 

-0.0113 ± j 0.7731 
-0.0339 

-0.0113 * j 0 . 7731 

-0.0345 

-0.0276 

q 2 = 10,000 

n c = 4 

n c = 5 

Compensator Poles 

-0.3643 * j 0 . 4136 
-0.0174 ± j 0.9667 

-0.3193 ± j 0 . 4740 
-0.0150 * j 0.9754 
-0.2129 

Compensator Zeros 

-0.0138 * j 0.7742 
-0.0357 

-0.0134 ± j 0 . 7719 

-0.0340 

-0.2609 


Third and sixth order compensators had some difficulties to converge for large q 2 - 
Minimization steps are usually performed with an accurate line search using a 
bracketing scheme. The line searches resulted in a very slow convergence of the 
error for large values of q 2 . The corresponding variations of the cost were of 10 
percent decrease per step. The infinity norm of the gradient (maximum absolute 
value of its elements) jumped back and forth between 10 2 and 10 * 3 . In order to 
cope with such a problem the software was modified to perform complete 
Newton-Raphson step with no line searches. The accuracy of the line search is 
highly dependent on the accuracy of the Lyapunov equation solver that eliminate 
P and Q. For large q 2 , Q becomes larger and relatively less accurate, resulting in 
less accuracy on the cost. Similarly, the search direction is highly dependent on 
the eigenvectors of the very small eigenvalues and may be less accurate. Step 4 
of the algorithm shown in Section 5.3.2 is modified as follows: 
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Step 4.i 


Compute gk, current gradient value 


SteD 4.2 

if ||gk|| < £ 0 , stop 

Step 4.3 

Compute Hk 

SteD 4.4 

Compute d£^ = -Hkgk 

Step 4.5 

If llgkll < e s , 


<k.,=V 

Else 



(Full Modified 
Newton Step ) 


Find <7k such that 

L(£ + <7kd£ ) is minimized: 
k k 

line search via bracketing 
{ k.i ■ * ^k 

Go to Step 4.1 

The full Newton step is still a modified step, like the one shown in Section 5.3.5, 
in order to deal with the singularity of the Hessian. The choice of the threshold 
e s below which no line search is performed is highly problem dependent. One 
wants to be close enough to the minimum so that the full step may converge. 
Indeed, a full step may increase the cost and result in a non converging sequence 
of steps. The threshold was set low for most of the runs. For large values of q 2 
however (q 2 = 1,000 and above) and for n c = 3 and n c = 6 the threshold was set 
to 100. The best accuracy one was able to reach was 6.2 10' 5 for q 2 = 10 5 and 
n c = 6, and 1.9 10' 7 for the same value of q 2 and n c = 3. 
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6.2.3.3 Discussion 

The transfer function from the process noise to the output of the system is the 
same as the open loop plant transfer function in this particular example. G(s) 
has eight poles and five zeros. As q 2 is increased, the poles of the Kalman filter 
designed for such a system go towards the minimum phase open loop zeros and 
the mirror image of the nonminimum phase zeros while the remaining poles go to 
infinity in a Butterworth pattern [Kwa72bj. Because of the separation principle, 
poles of the closed loop system with the full order LQG controller will follow such 
a pattern. This is not the case with reduced order compensators. Only for n c = 
3 do we have a closed loop pole going to infinity as Vq 2 . 


Table 6.3: Fast Closed-Loop Poles, nr = 3 


q 2 = 1,000 

a = -76.57 

a/^i 2 = -2.42 

q 2 = 10,000 

a = -241.12 

<*/Vq2 = -2.41 

q 2 = 100,000 

a = -761.74 

a/^ 2 = -2.41 


Some of the closed loop poles are near the open loop zeros or the reflections about 
the imaginary axis. For q 2 = 10 s and n c = 6, a pair of poles is at —0.0154 ± j 
0.9978 while another pair is at -1.2138 ± j 5.1850. For q 2 = 10® and n c = 4 a 
pair of closed loop poles is at -0.0186 ± j 0.9657. Looking at the trend, however, 
the same pair of poles was at —0.0190 ± j 0.9651 n c = 4 and q 2 = 10* . The real 
part does not converge toward —0.0199, the real part of the pair of complex 
conjugate open loop zeros. Figure 6.5 shows the root locus of the closed loop 
poles as a function of q 2 for nc = 4. 

Considering its simplicity, the reduced order compensators achieve 
performances comparable to the unconstrained optimum for very small orders(n c 
= 2, 4). Figure 6.6 shows the impulse response obtained with compensators of 
order 2 to 6 and q 2 = 1. These various responses are also compared to the full 
order response. Figure 6.7 shows a step response obtained with a second and a 
fourth order compensator and compares it to the response obtained with the full 
order controller for q 2 = 1. The impulse response shows that higher modes are 
more highly damped as the order of the compensator is increased. The step 
response shows however that very good command following can be obtained 
already with a second order controller. 
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Figure 6-5: Root Locus of the Closed Loop Poles for n* = 4 
and a? = 1 to 10* 
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Figure 6.7: Step Response, nr = 2. 4, 6, 8 
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6.3 THE NASA MINI-MAST 


6.3.1 Description 

The Mini-Mast [Nas89] is a 20 meter long generic space structure developed at 
the Structural Dynamics Research Laboratory at the NASA Langley Research 
Center. Its design duplicated except for its length the Mast truss envisioned for 
the COFS-I flight experiment. The materials as well as the manufacturing have 
flight quality specifications. The Mini-Mast has a three longeron construction 
forming a horizontal triangular cross section inscribed in a 1.4 meter diameter 
circle. 1.12 meter long battens connect the vertices of the triangles vertically to 
form a bay while diagonal elements provide stiffness in torsion and shear. The 
truss contains 18 repeating bays. It is cantilevered to the ground at its bottom. 
The structure has different possible configurations and can carry for example a 
tip mass to simulate a payload. This present example considers the mast only. 
Figure 6.8 shows a generic view of the beam and indicates the X-Y-Z reference 
frame that is used. The Z axis is vertical pointing up, while the X and Y axes 
are in the horizontal plane, the Y axis being normal to one of the faces of the 
triangular section of the beam (Figure 6.8a). 

The Mini-Mast is fully instrumented to support active vibration isolation 
experiments. The principal actuators are three reaction wheels mounted at the 
top of the structure. The spin axes of the wheels are aligned respectively with 
the X, Y and Z axes and will be referred to as Wheel X, Wheel Y and Wheel Z. 
It also has a dual set of sensors: noncontacting displacement sensors are used to 
monitor the motion of the vertices of the truss in the horizontal plane and 
normally to the face of the structure (Figure 6.8b). The second set of sensors are 
high quality rate sensors and accelerometers. 

The ‘strawman’ experiment proposed by NASA is to design a control 
system to minimize the relative deformation between Bay 18 (top) and Bay 10 
(mid mast). An available model had been obtained through parameter 
identification of the structure using the noncontacting sensors only. Because 
accurate optical based sensors can be developed to monitor the relative 
deformation of the structure, it is not too unrealistic to use the displacement 
sensors located on Bay 10 and 18 as long as they are aggregated to provide three 
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Figure 6.8: General Configuration of the NASA MINI-MAST 




relative measurements, the relative torsion between Bay 18 and Bay 10, the 
relative displacement in the Y direction between Bay 18 and Bay 10 and the 
relative displacement between Bay 18 and Bay 10 in the X direction. A very 
simplified control law is sought, consisting of three decentralized second order 
compensators, the first one feeding the relative torsion to Wheel Z, the second 
one feeding the relative displacement along Y to Wheel X and, finally, the third 
one feeding the relative displacement along X to Wheel Y. The decentralized 
compensator will then be evaluated against its centralized full order counterpart. 


6.3.2 The LQG Problem 
6.3.2. 1 The Mini-Mast Model 

The first two bending modes of the Mini-Mast are at 0.86 Hz. The two modes 
are really close because of the symmetry of the beam. The first torsional mode 
appears at 4.30 Hz. the second bending modes are at 6.17 Hz. A hundred and 
eight modes then cluster around 15 Hz and correspond to the bending modes of 
the diagonal elements constituting the bays. The model to be used is a tenth 
order model that includes the first and second bending modes as well as the first 
torsional mode and was obtained through parameter identification on an early 
setup of the experiment. The modes and damping ratios are summarized in 
Table 6.4. 


Table 6.4: frequencies and damping for the Mini-Mast 


lode 

description 

Frequency 
in rad/sec 

Damping 

Ratio 

1st bending 

5.3778 

0.0323 

1st bending 

5.3702 

0.0213 

1st torsion 

27.0133 

0.0717 

2nd bending 

38.4440 

0.0238 

2nd bending 

38.7478 

0.0100 


The main actuators are three reaction wheels mounted at the top of the structure 
and driven by DC motors. The dynamics of the motors are important and must 
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be included in the model. The motors cannot deliver any DC torque: on the 
Mini-Mast, at low frequencies, the transfer functions from voltage to torque are 
three high pass filters whose corner frequencies are at 3 rad/sec or 0.48 Hz. At 
high frequencies, the transfer function from voltage to torque rolls off like a one 
pole system. The second corner frequencies are well above the frequencies of 
interest, around 350 rad/sec or 55 Hz, and need not be modeled. The final model 
becomes a thirteenth order model that includes the ten original structural poles 
of the beam and three poles to describe the dynamics of the wheels. The inputs 
are: 

Ui = u z , command input on wheel Z in Nm 
U 2 = u x , command input on wheel X in Nm 
uj = Uy, command input on wheel Y in Nm. 

Six noncontacting displacement sensors are considered, the three 
monitoring the displacement of bay 18 (top of the mast) and those monitoring 
Bay 10 (mid mast). The information we want to extract are the relative 
displacements Xi 3 — Xio and Yu — Yio as well as the relative angular 
deformation about the Z axis 0 18 — 9 io- The information of the six sensors is 
therefore aggregated to yield only three outputs: 


y l = 8 is — 9 io (radian) 
ya = Y l8 - Yio (meter) 
y 3 = Xi8-X 10 (meter) 


The corresponding A, B and C matrices are given in Appendix D. 


6.3.2.2 Measurement and Process Noise 

The noncontacting sensors have an RMS error value of 10 * 3 inch or 2.54 10 
meter. After the measurements are aggregated, the measurement noises on y i, y 2 
and y 3 become: 


V c = diag(4.8092 10* 10 , 8.6021 IO' 10 , 8.6021 10* 10 ) 

The disturbance noise is chosen as a random voltage driving the three torque 
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wheels. The voltage is chosen to yield a 10 Nm RMS excitation: 


V = 102 bb t 


6 3.2.3 Quadratic Cost 

The maximum torque the motors can deliver is in the order of 50 Nm. The RMS 
value of the torque should not be higher than a third of the maximum torque. 
Using Bryson’s rule, the weighting matrix Rc is set to: 

R c = (50/3) * J I 3 

The regulated values are yi y 2 and y 3 : the control is to minimize the relative 
deformation between the top and the middle of the beam. The relative 
displacements are to be kept to within a millimeter whereas the angular 
displacement is to be kept within one milliradian (0.057 degree). The R matrix 
was selected as: 


T rio® o o 

R = C 0 10® 0 
0 0 10 ® 


c 


A Reduced Order Decentralized Controller (RODC) consisting of three second 
order compensators between yi and ui (Wheel Z), y 2 and u 2 and y 3 and u 3 was 
designed. The homotopy procedure was started by canceling any coupling 
between the torsional mode and between the bending modes in the X plane and 
the Y plane. The second bending modes were also made unobservable and 
uncontrollable. As the coupling was continuously introduced, the solution was 
tracked and no singular points were encountered. The decentralized controller is 
given in Appendix D. 
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6.3.3 Design Comparison 


The performance of the controllers can be judged on the RMS errors they achieve 
and the RMS inputs they required. Table 6.5 summarizes the results. Figure 6.9 
shows a close up of the location of the open loop poles and the closed loop poles 
obtained with the two designs. The Full Order Centralized Controller (FOCC) 
results in three poles on the real axis close to the origin: they correspond to the 
controller attempting to invert the zeros of the high pass filter of the wheels 
located at the origin. These modes do not contribute to the cost. Notice also 
that the FOCC results in higher damping of the second bending modes: the 
damping ratios of the second bending modes with the FOCC are 0.0416 and 
0.0255 respectively whereas the RODC can only achieve damping ratios equal to 
0.0262 and 0.0192. Figure 6.10 shows the minimum and maximum singular 
values of the plant transfer function while Figure 6.11 presents a comparison of 
the maximum and minimum singular values of loop transfer functions from the 
compensator inputs to the systems outputs with the two compensators. The 
RODC follows the shape of the loop transfer function obtained with the FOCC 
but with reduced gains. At low frequencies the RODC does not try to invert the 
zero of the wheels and behave like a differentiator whereas the FOCC transfer 
function is flatter between its slow poles and the pole of the DC motor. The 
RODC design also yields smaller gains on the second bending modes, providing 

less damping. 


Table 6.5: RMS Errors and RMS Inputs for the Qpen-LoQp.RQDC, and FOC C 


LU1C U.U. XVIVAO 

RMS Value 
of 

Open-Loop 

Full-Order 

Centralized 

Reduced-Order 1 
Decentralized i 

0 i g-0 l 0 

(rad) 

1.3198 10-2 

6.3020 10-3 

5.9202 10*3 

Yn-Yio 

(m) 

9.3478 10-3 

1.4251 10*3 

1.7618 10-3 

X 1 8“Y 1 0 

(m) 

7.9484 10-3 

1.9466 10-3 

2.4860 10-3 

U z 

(»«o 

0 

24.547 

24.841 

Ux 

(Nn) 

0 

22.258 

26.449 

Uy 

(«») 

0 

20.041 

20.087 
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The torsional mode is already well damped and its RMS value falls within the 
specifications. The relative displacements between the two bays is reduced by a 
significant amount even though the actuators are used above the limit of 50/3 
Nm. Hence, the displacement cannot be reduced to within a millimeter RMS. 
The designs were not iterated to make the control inputs fall within the 
specifications. The torque limitations make it impossible to achieve the required 
accuracy. These seemingly high RMS values are due to the large levels of 
excitation used in the problem. 

The RODC achieves very good performance given its extreme simplicity. 
The performance degradation is 6.8% of the open loop RMS errors while the 
control RMS inputs are 18.8 % higher than the FOCC RMS inputs. Notice that 
the torsion is kept within a tighter bound. The Y channel also requires much 
larger controls from Wheel X. The reason for this is that the centralized 
compensator deliberately couples the axes X, Y and Z. It makes use of the fact 
that the torsional mode is well damped already so that it can use Wheel Z to get 
extra authority on the bending modes. The full order controller has also more 
authority on the second bending modes. Figure 6.12 show the transient of y, and 
y 2 with the two different controllers for an initial conditions mostly in bending in 
the Y axis. The response of yj (Yig - Y 10 ) is very similar with both controllers, 
except for more overshoot and a smaller damping of the higher modes with the 
decentralized control scheme. The torsional response (yi) is much different, 
however, and the centralized controller gives rise to a much higher transient. 
This is due to the fact that the compensator uses Wheel Z in order to damp out 
the oscillation in bending as well. When the system has initial conditions mostly 
in torsion, the FOCC tends to cancel the coupling between the torsional mode 
and the bending modes whereas the RODC lets the Z channel excite the 
remaining X and Y channels. Figure 6.13 shows the transient of yi and U 2 with 
the two controllers. The torsional response is almost identical with both 
schemes. One can see, however, that the decentralized controller cannot 
anticipate the error coming from the coupling which is going to excite the 
bending modes on the X and Y channels: the transient of uj (Y wheel) shows 
that the command resulting from the decentralized scheme lags behind the 
command of the centralized compensator and requires, therefore, higher torque 
levels. One can also see that the RODC has longer residual oscillations. 

The controller transfer function relates three inputs to three outputs and 
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is therefore made of nine SISO transfer functions: the off-diagonal transfer 

functions of the decentralized controller are identically zero. The infinity norms 
of the transfer functions give an indication of their relative importance. For the 
decentralized compensator, the matrix of infinity norms is 


g rodc _1 ° 4 


2.2262 0.0000 0.0000 
0.0000 2.6752 0.0000 
0.0000 0.0000 0.8026 


For the centralized compensator, it is: 


g focc -1 ° 4 


3.5326 2.9372 6.3055 
2.4415 8.3367 3.9215 
7.8882 4.3139 6.2498 


The off-diagonal elements of Gp 0CC are comparable to the diagonal elements. 
This clearly illustrates the fact that the centralized controller couples inputs and 
outputs in order to obtain the maximum control authority in all three axes. The 
matrix Gp 0CC does not indicate any clear simplification of the control 
structure. The performance obtained with the decentralized controller is, 
however, very satisfactory. 
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Figure 6.11a: Loop transfer Function, Maximum Singular Value. 
: RODC. : FOCC 



frequency in rad/sec 

Figure 6. 11b: Loop transfer Function. Minimum Singular Value. 
: RODC. ; FOCC 
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Figure 613a: 9n - 9m, Transient Response for an Initial 
Condition in Torsion. : RODC, : FQCC 



time in sec 

Figure 6.13b: Wheel X Torcme Command. Transient Response for an Initial 
Condition in Torsion. : RODC. : FQCC 
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6.4 THESCOLE 


6.4.1 Description 

The SCOLE was constructed to provide a physical testbed for the investigation 
and validation of design techniques considering control structure interaction 
[Nas87]. A large plate representing a space shuttle model and weighing 500 
pounds is suspended by a single cable through a universal joint located as close as 
possible to the center of mass of the entire article. A light, hexagonally shaped 
structure representing an antenna reflector is attached to the bottom of the plate 
by a long flexible mast. The reflector and the mast both weigh about 5 pounds. 
Figure 6.14 shows the basic SCOLE structural assembly. A reference frame is 
defined as follows (Figure 6.14): the Z axis is vertical, positive in the upward 
direction; the X axis is aligned with the axis of symmetry of the shuttle; the Y 
axis is along the right wing (assuming the shuttle’s bay is below). The reflector 
is not deployed in a symmetric fashion: the reflector is attached horizontally to 
the mast and rotated to the right so that one of its sides is in the X direction 
(Figure 6.14). Aircraft quality rate sensors are available in all three axes both on 
the shuttle and at the end of the mast. More sensors, such as accelerometers can 
be used but are not considered here. The actuators consist of a Control Moment 
Gyros (CMG) on the shuttle and of three orthogonally mounted reaction wheels 
at the end of the mast. Torques in all three axes can be commanded both on the 
shuttle and on the reflector. 

The experiment proposed here is to control the displacement and attitude 
of the reflector relative to the shuttle such that, if the control is perfect, the 
composite system should act like a rigid body. Various control architectures will 
be proposed in order to illustrate the effect of reducing the order of the 
compensator and constraining the information pattern. 
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Figure 6.14: Gene ral Configuration of the SCOLE Experiment 
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6.4.2 The LQG Problem 


6 . 4 . 2 . 1 General 

The SCOLE has three marginally stable modes corresponding to the rigid body 
attitude motion about the universal joint. A small offset of the CG relative to 
the universal joint stabilizes the modes and makes the attitude observable from 
the rate sensors. This artifact makes the use of accelerometers unnecessary. The 
system also has two global pendulous modes corresponding to the swinging of the 
long attachment cable. Such modes are almost totally uncontrollable and 
unobservable from the actuators and sensors considered here and will be ignored. 
The remaining modes are flexible modes. The model used in this example utilizes 
the two first bending and the two second bending modes as well as the first 
torsional mode. Table 6.6 summarizes the frequencies and damping 
characteristics. The damping ratios were artificially set to 10 3 . 


Table 6.6: Frequencies and Dampi ng for the SCOLE 


Mode 

description 

Frequency 
in rad/sec 

Damping 

Ratio 

Rigid Body 

0.174021 

0.0010 

Rigid Body 

0.627081 

0.0010 

Rigid Body 

1.009350 

0.0010 

1st Bending 

3.554800 

0.0010 

1st Bending 

4.007660 

0.0010 

1st Torsion 

9.512380 

0.0010 

2nd Bending 

18.496300 

0.0010 

2nd Bending 

27.526200 

0.0010 


Six actuators are available for control. They are grouped as follows: 


u, = u S x, shuttle CMG, X input axis, lb-ft 

U2 = Umx, mast mounted reaction wheel, X axis, lb-ft 

U3 = u sy , shuttle CMG, Y input axis, lb-ft 
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u< = u n y, mast mounted reaction wheel, Y axis, lb-ft 

U 5 = u sz , shuttle CMG, Z input axis, lb-ft 

u 9 = u nz , mast mounted reaction wheel, Z axis, lb-ft 

The six rate sensors are divided as follows: 

yi = ysx, shuttle rate sensor, X axis, rad/sec 

y* = yax> mast mounted rate sensor, X axis, rad/sec 

ys = ysy, shuttle rate sensor, Y axis, rad/sec 

y 4 = ymy, mast mounted rate sensor, Y axis, rad/sec 

ys = ysz, shuttle rate sensor, Z axis, rad/sec 

ys = yaz, mast mounted rate sensor, Z axis, rad/sec 

The A, B and C matrix are provided in Appendix E. 

6.4.2.2 Measureme nt and Process Noise 

The noise properties of the various sensors can be found in [Nas87]. All rate 
sensors have an RMS noise of 0.005 rad/sec. The matrix V c is: 

V c = 0.0053 1« 

The process noise is taken as a random command on each of the actuators. The 
command is taken to be 0.3162 lb-ft RMS on the CMG’s and 0.1 lb-ft on the 
mast mounted reaction wheels: 

V = B diag( 0 . 1 , 0 . 01 , 0 . 1 , 0.01, 0 . 1 , 0.01) B T 

6 4.2.3 Quadratic Cost 

The maximum torque the CMG can deliver is on the order of 1.5 lb-ft. The mast 
mounted reaction wheels are smaller and can only deliver 0.1042 lb-ft. Following 
Bryson’s rule, the matrix Rc is chosen to be: 

R c = 33 diag( 1.5-2, 0.1042-2, 1 . 5 - 2 , 0.1042*2, 1.5*2, 0.1042*2) 
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There are five controlled variables to the problem in the vector z = Hx. 
Three are the relative attitude between the shuttle and the reflector, the 
remaining two are the relative displacements in the X and Y direction between 
the shuttle and the center of the reflector. Denoting by 0 X , 8 y and 0 Z the rotation 
about the X, Y and Z axis respectively, and by attaching a subscript ‘s’ for 
quantities relative to the shuttle and by ‘r* those relative to the reflector, the 
controlled variables are: 


Z\ — 0SX - 

8 rx» 

rad 

Z2 = Bsy “ 

Ary? 

rad 

Z3 = Bsz ““ 

Brzj 

rad 

1 

0 n 

n 

N 


inch 

N 

o« 

II 

*< 

CM 

1 

Y r , 

inch 

z = Hx 




The matrix H is given in Appendix E. The design goal is to keep the relative 
angles z u z 2 and z 3 within 0.3000 millirad ( 1 minute of arc). The penalty on the 
displacement was chosen to correspond to a 4-minute-of-arc misalignement of the 
120 inch long mast, or roughly 0.125 inch. The matrix R was chosen as: 

R = H T [ diag( 10*7, io-7, 10-7, 1.6 10*2, 1.6 10*2)]-i H 
6 . 4 . 2.4 Control Architecture 

The general control structure one wishes to implement consists of three 
processors controlling the X, Y and Z axes. The eigenmotions corresponding to 
the bending modes were purposely tailored to be skewed at ± 45 degrees in the 
X-Y plane (see B and C matrices). This makes the control difficult for the axis 
decoupled compensator and uncovers interesting limitations of fixed architecture 
controllers. The first architecture is that of a Reduced Order Decentralized 
Controller (RODC). It can be summarized in the following table: 


Processor 

Order 

Sensor 

Actuator 

1 

4 

1,2 

1,2 

2 

4 

3,4 

3,4 

3 

4 

5, 6 

5, 6 
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An improved architecture is sought and an overlapping structure is investigated 
next. The compensator is similar to the RODC with the modification that 
Actuator 4 is now available to Processor 1 and Actuator 2 is available to 
Processor 2, thus giving more authority on the reflector in the X and Y axes. 
The Reduced Order Overlapping Controller (ROOC) is as follows: 


Processor 

Order 

Sensor 

Actuator 

1 

4 

1,2 

1, 2,4 

2 

4 

3,4 

2, 3,4 

3 

4 

5, 6 

5,6 

The total order of the 

compensator is still 12. 

In order to evaluate the effect of 

the fixed information structure, the orders of processors 1 and 2 are increased to 
6. The last architecture is that of a Full Order Decentralized Controller (FODC): 

Processor 

Qrcte? 

Sensor 

Actuator 

1 

6 

1,2 

1,2 

2 

6 

3,4 

3,4 

3 

4 

5, 6 

5, 6 


The solution to the RODC problem was obtained by solving the problem 
with the 12th order model first. The initial diagonal system was obtained by 
removing the second bending modes and by decoupling the problem into three 
4th order LQG problems. The first torsional mode can easily be identified and 
was controlled along with the rigid body mode corresponding to the yaw by the Z 
channel. The mode shapes of the two first bending modes are strongly coupled in 
the X and Y axes. One was selected to be associated with the pitching mode and 
controlled by the Y channel while the last bending mode and the rolling mode 
were controlled by the X channel. As the coupling was introduced through the 
matrices R, V, B and C, the solution jumped from one path to another, to finally 
converge to a 12th order Full Order Decentralized Controller (FODC12) for the 
12th order system. The second bending modes were subsequently introduced and 
the homotopy procedure used again. Because they are significantly low and 
undamped, and because they are strongly coupled in the X and Y direction, the 
solution path jumped again from one path to another in order to converge. A low 
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accuracy was obtained on the RODC solution. The fact that both second 
bending inodes are to be controlled forces one controller to have fast poles. This 
breaks the symmetry between the first and the second compensator and both 
have to be modified so that they jointly take care of the first two and second two 
bending modes with only four poles, the remaining poles dealing with the rigid 
body motion. The final solution is a 12th order reduced order decentralized 
controller (RODC) for the 16th order plant. The solution was used as a starting 
point for the ROOC problem and direct minimization without homotopy was 
used to obtained the solution. The FODC solution was found also through direct 
minimization starting with the FODC12 solution whose dynamics were 
augmented to comply with the extra poles introduced in the X and Y 
subcontrollers. Convergence on the FODC was extremely good and the accuracy 
high. All compensators are in Appendix E. 


6.4.3 Design Comparison 

The RMS values achieved by the different designs are summarized in Table 6.7. 
Table 6.8 s umm arizes the optimal cost and the minimal damping achieved. 

The fixed architecture designs achieve performances very similar to that of 
the optimal solution: the worst performance degradation is 2.68 % of the closed 
loop RMS of Z 2 and is obtained with the RODC. The required inputs are 
however significantly higher: the RMS of X axis of the CMG with the ROOC is 
42.9 % higher than it is with the FOCC. Yet, it is still below 0.5 lb-ft which was 
chosen as the baseline. The RMS of u 8 (mast mounted reaction wheel, Z axis) is 
above the limit of 3.47 10-* lb-ft which is a third of the maximum torque. All 
designs require the same amount of RMS torque (within 0.6 %) from this 
particular actuator and the weight on u 8 should therefore be changed if one wants 
to iterate the designs. The overall performances are relatively poor even with the 
optimal compensator. The control authority on the CMG is low considering the 
large inertia of the system and the time constant of the closed loop rigid body 
modes is around one hundred seconds. The compensator must also consider the 
fact that the motion of the plate excites the vibrational modes and that the mast 
mounted wheels have also limited authority, limiting furthermore the bandwidth 

of the design. 
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tell 


HIS Value 
of 

Full Order 
Decentralized 

Full Order 
Centralized 

9sx~®rx (rad) 

2.7910 10 -3 

2.7848 10*3 

0gy~0ry (rad) 

2.2318 10-3 

2.2254 10*3 

0sz*""0rz (rad) 

9.9302 10-< 

9.9144 10 -* 

I s - Ir (in) 

2.9517 10-i 

2.9509 10-i 

Y, - Y r (in) 

3.4175 10*1 

3.4133 10*1 

Usx (lb-ft) 

4.3049 10-t 

3.9411 10-i 

Urx (lb-ft) 

2.4743 10-2 

2.5987 10-2 

U S y (lb-ft) 

3.7038 10*1 

3.1835 10-i 

U ry (lb-ft) 

3.2112 10*2 

2.9442 10-2 

u S2 (lb-ft) 

3.7732 10-i 

2.4051 10*1 

U r 2 (lb— ft) 

6.2598 10-2 

6.2283 10-2 
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Table 6.8: Optimal Cost and Minimum Damping for 
Different Control Architecture 


Control 

Architecture 

Cost 

Minimum Damping 
Ratio, 2nd Bend. 

Open-loop 

12,560.89 

1.0000 10-3 

RODC 

161.07 

1.5385 10*3 

ROOC 

160.73 

1.7692 10-3 

FODC 

156.78 

4.9231 10-3 

FOCC 

155.38 

5.7692 10-3 


Figure 6.15 presents a close-up of the closed loop poles and compare then 
to the open loop poles. Figure 6.15a shows the dosed loop poles obtained with 
the RODC and the ROOC while Figure 6.15b shows the locations of the poles 
with the FODC and the FOCC. The rigid body modes are moved to very similar 
locations with all designs with the slowest closed loop pole around —0.03 rad/sec. 
All four designs provide similar amounts of damping to the first bending modes 
as well as the first torsional mode which does not appear on the figure. A 
noticeable difference occurs with the second bending modes however. The FODC 
achieves 14.6 % lower damping compared to the FOCC. The reduced order 
compensators, on the other hand, are unable to provide any significant amount of 
damping. Notice that the overlapping architecture provides equivalent damping 
of both second bending modes whereas the decentralized architecture results in 
the highest mode having a smaller damping ratio (Figure 6.15b). 

Figure 6.16 shows the locations of the poles and zeros of the different 
compensators. All designs yield nonminimum phase zeros, with the fastest zeros 
being associated with the reduced order compensators (Figure 6.16c,d). Both full 
order compensators have a pair of lightly damped oscillatory poles close to the 
second bending modes of the plant in order to provide some damping. With a 
limited order, the RODC and the ROOC cannot achieve such pole locations. 
The result is that the bandwidths of Processor 1 and 2 split: the first 
subcontroller has two fast real poles around —5 and —27, the second subcontroller 
having its poles near the first bending modes. Figure 6.17 shows the minimum 
and maximum singular values of the open loop transfer function. Figure 6.18 
shows the maximum singular values of the compensator transfer functions. Both 
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full order designs have resonances located a the first and second bending modes as 
well as at the first torsional mode. The reduced order compensators, on the other 
hand, have a resonant peak at the first torsional mode, but must do some 
averaging between the first and the second bending modes. The damping 
provided by the reduced order controller will, therefore, be smaller. Figure 6.19 
shows the maximum singular values of the loop transfer function from 
compensator inputs to plant outputs with the various controllers. The agreement 
of the curves at low frequencies is excellent. The FOCC has deeper valleys 
between the resonant peaks of the loop transfer function. The reduced order 
compensators, on the other hand, result in flatter curves. 

The absence of symmetry between subcontroller 1 and 2 may be surprising 
since the bending modes have comparable observability and controllability 
properties from sensors and actuators in the X and Y directions. The fact that 
the second bending modes have to be controlled forces one of the controller to 
have a larger bandwidth, and the coordination between the controllers becomes 
more difficult when the architecture is specified, explaining in part the 
convergence problems. Because of the relative symmetry in X and Y, it is highly 
probable that a local minimum exists corresponding to Processor 2 having the 
highest bandwidth. When the decentralized solution obtained on the 12th order 
model is used to start the a direct optimization with the 16th order model, the 
successive compensators obtained through the iterations retain comparable 
bandwidths in X and Y. The minimization was not carried out completely, but 
one is confident that a more symmetric solution exists as well. The cost was, 
however, larger in that case, at about 164.5. 

When the cost is made of several equivalent contributions, the 
unconstrained compensator will be able to minimize independently each of the 
contributions. When constraints are introduced, these contributions cannot be 
minimized independently anymore, which explains why many differ en t trade-offs 
may occur and why compensators of very different character may be produced 
All designs may have equivalent performances if one only looks at the value of 
the cost. 
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Figure 6.17: Mini mum and Maximum Singular Valnps 
of the Ope n Loop Transfer Function. SCQLE Examsk 
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Figure 6-19: Maximum Sin gular Values of the Loop Transfer Function: 
FOCC. FODC. ROOC. RODC. SCOLE Example 
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6.5 CONCLUSION 


6.5.1 On the Performance of the Fixed Architecture Controllers 

This chapter has shown several examples of reduced order and fixed architecture 
control designs for realistic systems. Good performance was achieved by the 
constrained compensators. The nominal performance of the closed loop system is 
increased when more poles are added to the subcontrollers and when the 
constraints on the information flow and the control authority are relaxed. The 
SCOLE example has shown that the order constraints seem to be more important 
than the remaining architecture constraints, and more benefit is gained by 
increasing the order of the compensator than by letting sensors and actuators be 
shared by more than one subcontroller. 


6.5.2 On the Convergence of the Algorithm 

Inherent properties of the system can make the convergence of the homotopy 
procedure difficult. The four disk system of Enns being both unstable and 
nonminimum phase, the problem is numerically badly conditioned. Hence, the 
algorithm encounters some difficulties when the design tries to obtain high gain 
solutions. Again, the order of the compensator appears to be a very important 
parameter for the fast convergence of the algorithm. This was shown both on 
Enns’ system and on the SCOLE. Problems occur when modes having 
comparable effects on the cost have to be controlled using a compensator whose 
order is such that it cannot tune itself to both dynamics. This effect was mostly 
observed on the SCOLE, where the RODC had to find some average way of 
controlling the first and second bending modes of the system. Excellent 
convergence properties where found with the Mini-Mast, where no bifurcation or 
singular point were found. The choice of the architecture appears to be, 
therefore, of paramount importance for a fast convergence of the algorithm. 
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6.5.3 On the Choice of the Control Architecture 


The SCOLE example has shown that it is possible to obtain subcontrollers with 
separate bandwidths. The Mini-Mast example, on the other hand, shows that a 
locally decentralized control architecture, where three similar controllers are used 
to control three mostly decoupled channels, can also be found. The choice of an 
adequate control architecture is very important. The choice concerns both the 
order of the subcontrollers and the information flow in the compensator. As 
noted in chapter 1 and 2, some systems have asymptotic properties that make 
near optimal solutions easy to find, and where simpler control structures appear 
naturally. If these control structures are selected, the near optimal solutions can 
be improved by solving the constrained optimization problem and the homotopy 
algorithm is very likely to converge rapidly, as long as the plant is close enough 
to the ideal system for which the simplified controller is optimal. For weakly 
coupled systems, a locally decentralized architecture will achieve very high 
performance until the coupling reaches a limit for which the nature of the 
controller must change. Until this limit is reached, the homotopy procedure will 
have a high rate of convergence. For weakly connected systems, a two timescale 
control structure is near optimal. The slow control requires information and 
control authority on the global dynamics of the system, while the fast control 
requires local information and local conrtol authority. If such a structure is 
respected, the corresponding optimal H 2 fixed architecture controller will 
optimize the performance and will be found quite rapidly. As the slow and fast 
modes of the system merge, the control structure may have to change and the 
homotopy algorithm will encounter numerical difficulties. 

A large structure is neither weakly coupled, nor is it weakly connected. 
Coherent behavior can be observed at all the resonant frequencies. Locally 
decentralized control should not, therefore, be used. A distribution of the control 
over the frequencies can, however, be envisioned. Such a scheme appears 
naturally in the form of independent modal control [Mei87]. The fixed 
architecture design procedure is, however, much more flexible, and potentially 
more robust. If the sensors and actuators are grouped in such a way that the 
resulting information and control authority is concentrated on one particular 
mode, the corresponding compensator will be tuned to that particular mode. The 
fact that higher modes are included in the design should prevent spillover. 
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The bandwidth separation obtained on the SCOLE resulted in poor convergence 
properties because both subcontrollers had similar information and control 
authority on the first as well as the second bending modes. 


6.5.4 On Robustness 

The issue of robustness has not been addressed in the examples. The H 2 fixed 
architecture control problem does not include any direct attempt at making the 
design more robust. Hence, the simplified controllers that have been obtained 
cannot be expected to tolerate more disturbance and perform well for larger 
uncertainties. An increase in robustness may, however, appear, simply because of 
the fact that constrained controllers are overall suboptimal solutions of the LQ 
problem. They will be less finely tuned to the model and may, consequently, 
tolerate higher level of uncertainties. 

A quick assessment of the robustness properties will show, in the case of 
the SCOLE, that the RODC becomes unstable before the LQG design when the 
first torsional mode is made extremely soft and almost unstable. The unstability 
occurs on the second bending modes which are less damped with the RODC. The 
first bending and rigid modes will, however, change slightly more with the LQG 
controller. This rapid assessment will prove that improvements may occur, but 
that, once again, the architecture chosen for the design must be properly chosen, 
or the constrained design may be in fact less robust to plant uncertainties. 


219 



220 



CONCLUSIONS AND RECOMMENDATIONS 


7.1 SUMMARY 


This thesis has extended the Linear Quadratic Gaussian design techniques to 
introduce the possibility to constrain the architecture of the compensator. The 
general form of feedback that it allows is a decentralized processing structure 
where the controller is made of p subcontrollers having totally uncoupled 
dynamics, each of which is connected to selected sensors and selected actuators. 
This general architecture can produce controllers of very different character. Full 
order, dyn ami c, centralized controllers, reduced order, dynamic, centralized 
controllers, decentralized, dynamic, controllers, and multi-timescale controllers 
all obey the general rules developed to constrain the control architecture. The 
decentralized static case has also been considered, but it has not been studied in 
details. 

Optimality based techniques, and especially Linear Quadratic, or H2, 
techniques, have been very successful at producing Multi-Input, Multi-Output 
compensators. The generalization of such methods was undertaken to allow the 
design of simpler feedback structures that follow hard implementation 
requirements such as limitation in the processing capabilities, complexity in the 
wiring and in data collecting, or modular assembly necessitating that each 
module have its own controller. 

This thesis has posed the H2 fixed architecture control problems (dynamic 
and static) and derived the necessary conditions for optimality for them. These 
conditions have the form of highly coupled matrix equations. The properties of 
these equations have been studied and the investigation has focused, in 
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particular, on possible simplifications that could occur because of the structure of 
the problem. Such simplifications occur in the full order centralized problem, 
and to a lesser extent, in the reduced order centralized problem. 

Homotopy methods have been reported successful at solving complex 
coupled matrix equations and continuation procedures have been developed to 
solve the reduced order control problem. This thesis has considered the use of a 
homotopy algorithm to solve the general H 2 fixed architecture dynamic control 
problem. The convergence properties have been studied at length and have led to 
a broader understanding of the number and the nature of the solutions to the 
constrained problem. 

Design examples have shown the performance of simpler controllers for 
flexible space structures. The examples have also helped understood some of the 
issues in choosing the architecture of the controller and, more particularly, the 
effect of limiting the order of the overall compensator. 


7.2 THESIS CONTRIBUTION 


The contribution of this work has been to broaden the understanding of the 
effects of the architecture constraints on the Hj optimal dynamic control 
problem. The structured conditions obtained in Chapter 4 have shown how the 
full order problem, which necessitates the solution of the two uncoupled Control 
and Filter Algebraic Equation (CARE and FARE), becomes more complicated as 
the order of the dynamics of the compensator is, first, reduced and, next, when 
the processing is decentralized. The reduction in the order of the compensator 
couples the filter and the control problem. This was shown in [Hyl84]. The 
optimal coupling requires the computation of a projection operator, and the 
CARE and FARE become modified Riccati equations, where the projection 
cancels out some part of the quadratic terms entering the equations. This thesis 
has shown that the decentralization of the processing also requires that the 
different subcontrollers be coordinated, so that they, as a whole, minimize the 
quadratic cost. The most general fixed architecture control problem requires the 
simultaneous solution of modified filter and control Riccati equations coupled 
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through four Lyapunov equations which yield the optimal coupling, which is no 
longer a projection, and the optimal coordination between the subcontrollers. 

This work has also shown that the solution of the optimality conditions 
can be decomposed and that the gains and the dynamics of all the subcontrollers 
can be solved as functions of the remaining variables in the problem. It is not 
possible, however, to obtain an analytic expression that would allow for a closed 
form substitution of these matrices in the remaining equations, in the most 
general case. Hence, the structured conditions do not lead to any noticeable 
simplification of the problem. The numerical algorithm developed in this work 
has, consequently, used the gain and dynamic matrices of the controllers as 
parameters and in order to solve a parameter optimization problem. 

The H2 fixed architecture control problem has an obvious solution when 
the system is made of totally independent subsystems. The motivation for using 
homotopy is that it should be possible to start from such simple solutions and 
follow the optimal solution as the parameters of the problem are changed from a 
simpler decoupled form to their actual values. This approach was suggested in 
[Ric87] for solving the reduced order control problem. This work has extended 
the idea and developed a procedure for the more general fixed architecture 
problem. In the process, one has developed an analytic expression for calculating 
the Hessian, or matrix of second derivatives of the cost with respect to the 
control parameters, and the nature of the solutions has been studied. The study 
has shown that the optimality conditions for the constrained LQG problem have 
many solutions. Some of the solutions yield stable closed loops, while others 
yield unstable closed loop. Among the stabilizing solutions, which are the only 
one of interest, some solutions are local minima and others are saddle points. 
The nature of the solution is not invariant under homotopy. When a critical 
point is encountered along the solution path, an eigenvalue of the Hessian 
becomes zero and may change sign. In that case, a minimum can become a 
saddle and a saddle can become a minimum. Bifurcating solutions may also 
occur. Another phenomenon is that the optimal solution that initially stabilizes 
the plant may become, in a continuous fashion, a nonstabilizing solution. The 
cost goes, in that case, to infinity, but the control parameters remain on a 
smooth path. A chosen architecture may not produce any stabilizing controllers 
for a particular system. If the unstable poles of such a system are continuously 
move in the left hand plane, the problem will then have a stabilizing solution. 
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Hence, the tracking of the stabilizing solutions only will not guarantee that a 
possibly stabilizing solution will be found. The homotopy must, therefore, track 
all the solutions to optimality conditions in order to be a global tool. The 
alternative taken in this work is to allow for noncontinuous solution path and let 
the algorithm look for local minima when a critical point is found. When the 
problem does not have any stabilizing compensator, the numerical scheme will 
stop converging toward the desired problem and the program will then abort. 

The numerical examples have shown that the order constraints are the 
most stringent. If the order of the compensator is not large enough, the solution 
cannot tune itself to the dynamics of the system and tries to find an average that 
is hard to find in most cases. In general, the fixed architecture control problem 
converges rapidly and produce a high performance feedback if the problem admits 
near optimal solutions with the particular architecture chosen. For example, 
simpler near optimal controllers can be obtained for weakly coupled subsystems 
by ignoring the coupling and solving independent control problems. The 
optimization of these decentralized controllers will result in better performance of 
the closed loop system. The choice of the order of each subcontroller must leave 
enough freedom to let the dynamics of the controller tune itself to those of the 
system. When the architecture of the controller has too many constraints, the 
optimization produces a solution which tries to have some average action on 
different contributions to the cost and may result in poor overall performance. 
The homotopy is also less likely to converge continuously, since the starting 
solution has a character much different from that of the solution to the actual 
problem. 
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7.3 DIRECTIONS FOR FUTURE WORK 


The first important issue to be studied is the choice of the control architecture. 
Both the order of the subcontrollers and the sensors and actuators that they use 
greatly influence the overall performance of the design. As shown in Chapter 6, 
the residual improvement obtained by increasing the order of the compensator 
may, however, be minimal above some number. The cost component ranking 
method of [Ske80] is a very interesting idea for selecting the order of the 
controller, since it breaks up the cost into several contributions from different 
part of the dynamics of the system. Hence, it can show what parts of the 
dynamics can be ignored, or need not be controlled. As for the choice of the 
sensors and actuators, [Ske83] and [Del90] have both proposed some schemes 
that, both, rely on weak coupling ideas. These studies can lead to general rules 
for choosing the architecture and should be pursued. 

Numerical improvements should also result from a better choice of the 
architecture. If the unconstrained solution has already a marked decentralized 
character, the corresponding constrained solution will converge very rapidly. 
More generally, a more careful study on how to choose the inital problem should 
be undertaken. Alternate ways of getting the different gradients can also be 
studied. The current algorithm cannot handle very high order compensators with 
large n um ber of sensors and actuators, since the number of parameters increases 
rapidly. The computation is, however, very well suited for parallel processing. 

A second important issue that has not been investigated is the issue of 
robustness. Simplified controllers are only suboptimal if one considers the 
unconstrained LQG problem. If the architecture has been selected so that only 
the predominant dynamic effects are controlled, it is possible that the controller 
will not try to minimize the residual effects which may be the result of higher 
modes in the system, or coupling between subsystems. The constrained 
controller will, therefore, be less sensitive to modeling errors which are bound to 
be higher on the detailed description of the system. Being less finely tuned, the 
constrained controller may be more robust. This is not a guarantee, however 
The H 2 problem itself has been modified to take robustness into consideration 
right away in the optimization. Considering the modified H 2 cost functional of 
[Ber87a, Che88], the problem can be generalized with the addition of the 
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architecture constraints. The Filter Laypunov equation of Chapter 3 will 
become, in that case, a modified Riccati equation. The remaining optimality 
conditions will be slightly modified, but can still be obtained using matrix 
calculus as easily they were in the H 2 case. 

Finally, the problem can also be extended to the constrained H 2 /Hod 
problem. The reduced order case is presented in [Ber89], and the introduction of 
architecture constraints can be done in a way very similar to the one used for the 
H 2 problem, once the new cost functional has been defined. Again, a Riccati 
equation replaces the Filter Lyapunov equation in order to get the H® bound. 
The numerical aspects of the robust control methods may, however, reach 
another level in complexity, and these methods may not be very pratical. 
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APPENDIX A 


A.l Proof of Theorem 4.1 


Theorem 4.1: Let C, D, X, R be matrices in R mIm , R nfn , R am and R mIn 

respectively, C and D symmetric, positive semidefinite. Let E x = { E i; E 2 , • • •, 
E p } be a family of independent matrices on R mIn . Consider the system of 
equations: 


X = E x *x, x 6 R* 5 

TrEj T CXD = TrEj T R, j = 1 , • • • ,P 


(4.2.4) 


where * follows Definition 3.1, and E x defines the subspace where X lies. Such a 
system is a linear system. It has a unique solution if C and D are definite. It has 
an infinite number of solutions, otherwise, if: 


Ker(C) C KertR 1 ) 
Ker(D) C Ker(R) 


(4.2.5) 


Proof: The system of equations defined by Eq.(4.2.4) is clearly a linear system in 
the matrix variable X. X is required to be a linear combination of the matrices 
Ei, E 2 . •••, E p . Eq.(4.2.4) requires that the projection on Ej of the product 
CXD be equal to some specified value. The proof of the theorem necessitates 
some preliminary lemmas. 
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A.2 Preliminaries 


Lemma A.l: Given an' n*n matrix X, which is symmetric, positive, semide finite, 
with rank p, there exists an n*p matrix R which is full column rank, such that: 

X = RR T 

■ 


Proof: X being symmetric, it is diagonalizable. Its eigenvalue decomposition is: 


X = T 


A p 0 
0 0 


where T is unitary (TT 1 = I), and where A p is a diagonal matrix with strictly 
positive entries, [Gan59]. Block partitioning, the first p columns of T can be 
regrouped in a matrix Ti. Define the matrix as the p-dimensional diagonal 
matrix whose diagonal elements are the square roots of the diagonal elements of 


A p . The matrix R can then be defined as: 


R — T i^Ap 


(A.l) 


R is full column rank since -JK p is nonsingular and since Ti is full column rank. 
Hence, it satisfies Lemma A.l. □ 


Lemma A.2: Consider two n*n symmetric matrices X and Y such that X is 

positive semide finite and Y is positive definite. Then, 

Tr(XY) > 0, 

and Tr{XY) — 0 if and only if X = 0 n ■ 

Proof: Y being positive definite, there is, according to Lemma A.l, a nonsingular 
n»n matrix S such that: 

Y = SS T (A. 2) 

Using Eq.(A.2), we get: 

Tr(XY) = Tr(XSS T ) 

= Tr(S T XS) 
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T 

X being positive semidefinite, S XS is also positive semidefinite. Its trace is 
equal to the sum of its eigenvalues. Hence, the trace is strictly positive, unless 
all eigenvalues of X are zero. X being symmetric, this would imply that X is 
identically zero. 

□ 


L emma A.3: Let C and D be positive, semidefinite, such that: 

c = ca t , c.E*”” 1 

d = d,d, t , d^s”” 1 

where k and 1 are the respective ranks of C and D. Let R be & generic m*n 


matrix. Then, if the following is true, 


Ker(C) C Ker(R X ) 


Ker(D) C Ker(R) 

(A.3) 

R will satisfy. 

* ** _ m fm f*| 


R = Ci(Ci T Ci)-'Ci I RD 1 (D, a D 1 )' 1 D, 1 

(A.4) 


T 

Proof: the existence of Cj and Dj is guaranteed by Lemma A.L Ci Ci and 

Di T Di are both invertible since C t and Di are both full column rank. 
Ci(Ci T Ci)' 1 C! T is an orthogonal projection parallel to Ker(C). Indeed, if v is in 
Ker(C), then C = 0, and if v is perpendicular to Ker(C), v = v. Similarly, 
Di(Dj is an orthogonal projection parallel to Ker(D). Consider a 

general vector v in R n . v can be written as: 

V = Vi + Vi, 

with v x 6 Ker(D) x , v 7 6 Ker(D)\ Since Ker(D) c Ker(R), Rv = Rtfj. Hence: 

R = RD^D^DOW (A. 5) 

Consider now a vector w in R“. w can be written as: 

W = Wi + Wi, 

with v)\ 6 Ker(C) A , w 7 6 Ker(C) x . Because Ker(C) C Ker(R T ), R T u> = R T u> and: 
R T = R T C 1 (C, T C 1 )- 1 C, T 
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or: 


R = C 1 (C, T C,)‘ , C, T R 


(A.6) 


Combining Eq.(A.5) and Eq.(A.6), we get the desired equality. □ 

A.3 Uniqueness 

The uniqueness of the solution is obtained by looking at the system of equations: 

p 

X = E XjEj (A. 7) 

i" 1 

0 = TrEj CXD, j = 1, • • • , p (A. 8) 

(A.7) is the expanded version the expression E**x. Eqs.(A.7,8) constitute the 
homogeneous part of Eq.(4.2.4). Consider the following linear combination: 

P T 

L = E xj TrEj CXD 
j»i 

P T 

= Tr(E XjEj 1 CXD) (A.9) 

j*t 

One can recognize that the summation is only Eq.(A.7). Eq.(A.8) implies that L 
is zero. Hence, Eq.(A.9) yields: 

0 = Tr(X T CXD) 

T 

If D is positive definite, X CX must be zero (Lemma A. 2). If C is also positive 
definite, this implies that X must be zero. Hence, the homogeneous part of the 
linear system admits zero as its unique solution. The system having as many 
equations as unknowns, this implies that it has one and only one solution. □ 
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A.3 Exist ence of a Solution when C or D are not Definite 

Consider, now, the case where C or D are not definite. Assume that C has rank k 
and D has rank 1. According to Lemma A.l, there exists a m»k dimensional 
matrix C t and a n*l dimensional matrix D! such that C! and Di are both full 
column rank, and such that: 

D = D jD j T 

c = ca t 

Eq.(4.2.4) becomes 

TrEjR - Tr(Ej CiCi XDiDj ), j = 1 ,* • •, P 
= Tr((C, T EjDi) T C, T XD0 

Define Xi as: Xi = Ci^XDi (A. 10) 

and define Ej 1 as: 

Ejl » Cj T EjDi ( A11) 

The Ej 1 are k*l matrices. Xj is also a k»l matrix. Assume, further, that 
Eq.(4.2.5) are satisfied. Lemma A.3 is, therefore satisfied by R. Defining Ri as: 

R^C^Ci^cjRD^Di)- 1 


r, is an k«l matrix. X, satisfies the following system of equations: 

P 

Xi = ExjEji 

_ _ j * 1 t T 

TrEjC/RiD, = TrEj CiXA , j = 1, — , P 


(A. 12) 


Using the properties of the trace operator, and using Eqs.(10,ll), the system 
becomes: 


Xi = E xjEj 1 

j * l 

TrEji T RfTrEj» T X|, j = 1, - * •, P 


(A- 13) 
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Xi satisfies a system of equations similar in every way to that defined in Theorem 
4.1, where the matrices that play the role of C and D in that new problem are, 
respectively, Ik and Ii which are positive definite matrices. The problem defined 
by Eq.(A.13) has, therefore, one and only one solution. A general solution to 
Eq.(4.2.4) is: 

X = C i(C t T C i) *‘Xi(D i T D i) **D ? + C 2 MD 2 T 

where M is any m— k*n-l matrix, and where D 2 spans Ker(D) and C 2 spans 
Ker(C). □ 
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APPENDIX B 


B.l Statement of the Problem 


We consider, in the following, that there is a single compensator in the feedback 
loop and that G, Ac and K are block partitioned as follows: 


G = [Gi G 2 ] , A c 


A11 A 12 
A21 A22J ’ 


K = 


[*,1 


(B.l) 


The triplet of matrices ( G, A c , K) can be expanded on a basis of matrices 
(Definition 3.1) and is completely defined by a column vector £ containing the 
free entries of G, Ac and K. Assume that £ is formed in the following fashion: 




an 
* 1 
9 1 
a2i 
*2 
ai2 
97 
022! 


(B.2) 


where a n is a column vector containing the free entries in A„, h is a column 
vector containing the free entries in Kj, etc. The Lagrangian can be partitioned 
accordingly: 
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L L . L 

OnOn on*i 

L fc,a u L *i*i h k l9l 

l L . L 

0iOn 0t*i 0i0i 

L L , L 

fl2lOll 021*1 02101 

L *ia„ L k,k, L k,g, 

L L , L 

®12<*U ®i2*i ®i20i 

L L , L 

93 a u 02*1 0201 

, L L , L 

L fl22flll ®22*1 02201 


, L , L 

ana2i au«2 o >\\ o .\2 

^*1021 *1*2 ^*1012 

, L , L 
9 1O21 9 1*2 01O12 

, L , L 

02 1 021 021*2 02l0l2 

^2021 ^^2^2 ^^»2 a 12 
J ai2fl2i O12A2 ^0i20i2 

, L , L 
9 2O21 <?2*2 02®12 

- L , L 

022021 022*2 022O12 


L L 

01102 Ona 22 

k 102 A1O22 

L L 

0102 5 l fl 22 

L L 

02102 02 J 022 

k2 9 2 k2d22 

L L 

01202 Oi 2022 

L L 

0202 02022 

L L 

02202 O22O22. 


B .2 Uncontrollable Compensator 


Theorem B.l: Assume that A21 = 0 and K2 = 0 . The modes corresponding to A22 
are uncontrollable from K. The compensator matrices have the form: 


G = [Gi G2] , 


_ A. 11 A 
c A22J ’ 



(B.3) 


The following equations hold in that case: 


0 = L 

011O12 

0 ' L Oh02 

0 = L 

0ufl22 

0 = L AiOi2 

0 = L A,02 

^ **^1022 

0 = L 0lfll2 

0 = L 

0102 

^ ” ^01022 

^ ^Oi20i2 

0 = L 

0 1202 

0 = L 

0 12022 

0 = L 

9 2O12 

0 = L 

0202 

^ **02022 

0 = L 

022012 

0 = L 

0 2202 

0 = L „ 
022022 


Proof: the matrix A c i, P, Q and V c i have special forms when the compensator is 
uncontrollable. Extending the partitioning of Eq.(3.3.2), and using Eq.(B.3), we 
get: 
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(B-4) 



' A BGt 

BG 2 


' V 0 T o' 

A c i = 

K iC A n 

A 12 

, V c i = 

0 KtViKi 0 


. 0 0 

A 2 2 j 


0 0 0 


The corresponding Q becomes: 


Q = 


Q oo Q o 1 0 
Q to Q ii o 
ooo 


(B.5) 


Consider, now, a general perturbation of the compensator corresponding to a 
variation AAu in A^. Every matrix with superscript " 1 " corresponds to the 
derivative of that particular matrix in the direction AAu- 


Aci 1 = 


0 0 0 
0 0AA 12 
0 0 0 


, Vd 1 = 0, Rci 1 = 0 


(B.6) 


The matrix Q l satisfies the Lyapunov equation obtained by differentiating 
Eq.(3.3.20): 


0 = AciQi ♦ q^ci 1 * Veil + AciMJ + QAcit T (B.7) 

T T 

Given the form of Q and Ad 1 , the term A^Q + QAci 1 is zero. Similarly, P 1 
satisfies: 


0 = A c i^P l + P‘A c i + Rci 1 + Ad 1 P + PA c i l 


(B.8) 


Rci 1 is zero (no dependence on A 12 ) and: 


Aci^P + PAci 1 = 


0 0 P 0 1 AA 1 2 

0 * 0 rp <T P 1 1 AA 12 

_AA 12 P 10 AA 1 2 ? 1 1 AAuP 1 2 + P 2 iAA 12 


Because of the form of A c i, Eq.(B.4), the corresponding P 1 will be: 
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0 0 P 02 

pt= 0 0 P 12 (B.9) 

P 2 0 P 2 I P22. 


Hence Q 1 is zero. Using Eqs.(B.5,9) and the fact that Qi = 0, the matrix M l 
becomes: 

■ 1 = PIQ + PQi 

0 0 O' 

= 000 (B.10) 

M20 1 Mai * 1 0 


Hence, M 10 l = 0, M 0 i l = 0, M u l = 0, M 02 1 = 0, M 22 1 = 0 and M 12 1 = 0 for any 
perturbation in A 12 . The matrix equation L^, Lg and Lg depend on P, Q, G, A c 

and K. Since they are matrix equations, one can look at some blocks only. The 
block partitioning follows the same rules as in Eqs.(3.3.8-13) or Proposition 3.1. 
When the matrices are varied in only one direction (corresponding, for example, 
to a given AA 12 ), the derivatives of and Lg are matrices of similar 

dimensions that will be denoted by the superscript " 1 Using Eq.(3.3.8-10) and 
using Eq.(B.lO), we get: 

L. 1 = Mu 1 = 0 
« n 

L. 1 = I,2 l = 0 
*12 

L 1 1 = M 22 * = 0 
*22 

This being true for any AA 12 , and writing the various equations in vector form, we 
get the following equations: 


0 

0 

0 


an<ii2 

ai2<»i2 

<* 22^12 
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Gt is zero (no dependence on Au), and Q 1 is zero. Hence, differentiating 
Eq.(3.3.9): 

L q i= B^oc 1 

= [B T M 0 i 1 B T Io2 1 ] 

Moi 1 and M 02 1 being zero, Eq.(B.lO), we obtain: 

v =o 


This being true for any A A 12 * we have: 


0 

0 


L 

9 1«12 
L 

9 2<*12 


Finally, differentiating Eq.(3.3.10): 


V 


hi 


Pcc'KVc ♦ «coC T 


1 

0 

P 12 l 


"KlVci 


1 

0 

1 

*0 

1 p 22 l 


0 

1 

+ 

O 

1 


Thus, LjJ = 0. This holds for any AA 12 , therefore: 

0 = L *i«i2 


In summary, 


, =0, L =0, L =0, L =0, L =0, Lr = 0. 

a lid 12 ’ dl2<*l2 <J22fll2 9 t a 12 9 2 fl 12 *l fl 12 


Similarly, one can consider a perturbation corresponding to a variation AG 2 
in G 2 . Computing A c i l , V c i l , R c i l , P l , Q l , M 1 , etc. for such a perturbation, and 
using the special form of Q and A c i, one would obtain the required equalities for 
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L , L. etc. Variations in A 22 are handled in a similar way. The algebra is 
CLu9 2 * 1$2 

straightforward and the proof is not developed any further. □ 


B.3 Unobservable Compensator 


Theorem B.2: Assume that G 2 = 0 and A^ = 0. The modes corresponding to A 22 
are now unobservable from G. The compensator matrices have the form: 

<kg,o], JJ. i-gy 

The following equations hold in that case: 

0 = 1 

0 = L 
0 = L 
0 = L 
0 = L 
0 = L 


411421 

0 = L 4u*2 

^ ^4[ifl22 


O 

II 

e-* 

iV 

to 

^ ^Al422 

9 l a 21 

c* 

►-3 

tf 

O 

^ ^?l422 

<221421 

0 = L 42lA 2 

o = l a 

421422 

£2421 

0 = L k 7 k 2 

^ ^^2422 

<*22421 

^ ~ ^422&2 

0 = L A 

422*22 


Proof: the proof follows the same steps as for the uncontrollable case. The roles 
of P and Q must however by changed. A rigorous method for obtaining the proof 
is to consider the dual problem which is exactly the case treated above. This is 
equivalent to exchanging the roles of A 12 and A 21 , B and C, G and K, P and Q. 

□ 
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APPENDIX C 


The Two Coupled Beam Example 


Compensator Realization. K = 10.0 


AC1 


Columns 1 thru 3 


-2 . 0790350735881 290-01 





-2 . •315062272362570+00 
-8 . 8570606799237780+00 


Column* 4 thru 


8 . 8570606799237780+00 
-2 . 0315062272562570+00 


AC2 


Column* 1 thru 3 
-0 . 5346768582295250-01 
-5 . 32960 1 01 9501 581 0-01 

0.0000000000800000 l 08 
0 . 0 0 80000000000000 1 00 


5. 529691 01 9591 5610-01 
-9 . 5346768582295250-01 



-2 . 6288404778484990+00 
-8. 40591 60771 1 03160+00 


Column* 4 thru 4 

0 . 6 066666600606000 1 00 


6 . 4059 1 6077 1 1 05 1 60+00 
-2 . 6288404778484990+00 
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G 


Columns 1 thru 3 

-9 . 01 63431 991 963460+41 7. 9841 *99 130073020+01 4.2719870930078800+49 

0 . 0000000000000000+0# 0 . 0000000000000000+00 0 . 0000000000000090+00 

Column* 4 thru 0 

-7 . 0303060360900390+00 0 . 0000000000000000+00 0 . 0000000000000000+00 

0 . 0000000000000000+00 -2 . 1 023239030328230+02 7.17729831 47343330+0 1 

Column* 7 thru 8 

0 . 0008880008008800+08 0.0000000000000000+00 

-1 .2307303303041990+01 •1.2S3002048239188O+01 


3 . 947282021 4029000-03 
8.9192083030102310—02 
-2 . 909482801 8292800-0 1 
-1 .2893303313939080+00 



8 ■ 00099998999 0 000O+08 
0 • 0880088809889900+00 

-1 .2737379480470700-02 
3 . 40879871 1 2343300-02 
-1 2274013440980840-01 
6 . 2390970328303710-01 



From Forward Integration 


AC1 


Column* 1 thru 3 



7 . 0292909309101370+01 


1 . 0800090089899000 1 00 

-2 . 6733730798339370+02 



-7.914000082340S77O+01 


Column* 4 thru 4 



-1 .1227100707710910+01 
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AC2 


Columns 1 thru 3 

a . aeeeeeeaaeeaeeao+aa 

a . eeaaaeeeeeeeeeeo+«e 


-2.3915322138181790+81 


i . eeaaaaaaeeeeaeeo+aa 
a. 
a. 

-2 . 2876247 1 a 1 933330+82 


a . aeeaaaaaeaeeeaeo+aa 
i . eeeeeeeaaeeeeeao+8e 


-8 . 478728688941 4340+81 


Columns 4 thru 


1 . 6888888888888880+88 

-1.1887371482517810+81 


G 


Columns 1 thru 3 
-1 .6848971873963390+81 

a. 


3 . 2366439338898960+82 


-2 . 41 23837889998260+8 1 
6 . 68888988 8 9888880+88 


Columns 4 thru 6 
2 . 7932333936899540+81 

9 . 6988888888889980+88 


1 . 83721 1 8244877280+81 


2 . 7888821 487658390+8 1 


Columns 7 thru 8 
-8 . 688292621 6328380+81 1 . 1 433312983484380+88 


K 


8. 

9. 

9. 

1. 

9. 

9. 

9 . 

9 . 


1. 


/ 
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Integration 


•2 . 97071 43963385300+02 



-2 . 029796S2369S422O+01 


-2 . 81 00741 492848340+01 


3.181 62740621 9331 0+82 -2.1631 424829303730+0 1 


0 . 0000000000000000+00 0 . 0000000000000000+00 
-1 .2006776450502740+01 9.7086538200945180+00 


0 . 0000000000000000+60 
-3 . 3+3454231 6547580+00 
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Compensator Realization. K = 2.0 


From Forward Integration 


AC1 


Column* 1 thru 3 


0 . 9999999999999990*99 
9 . 9999999999999990*99 
-3 . 377240039 1 42 1 03040 1 



-2 . 5897614401 6721 60402 


Column* 4 thru 4 

e . 0000009000000000400 
0 . 0000000000000000400 
1 . 0000000000000000400 
-1 .2937603228193630401 


AC2 


Column* 1 thru 


e AAAOAAAAdAAAAAAnjJKA 

e . eeeeeeeeeweeeeo+te 

-5 . 1 07853294669065O+6 1 


0 AAAAAAAAAAA AAAAH * AA 

-2 . 5675868306293040+02 


Columns 4 thru 4 

d mmmm mmmm m mmmmmmm . mm 

-1 *7219506297006860+01 


Columns 1 thru 3 
♦ . 4634627272341360+01 


3 . 5561009233346660+02 

0 . 


Columns 4 thru 6 
2 . 0662036402357390+01 
0 . 0000000000000000+00 


0 . 0000000000000000+00 
-7 . 375 1 533716122390+01 


Columns 7 thru 


-5 . 267945704741 9 1 20+0 1 


0 . 0000000000000000+00 
1.062395665978150O+01 


K = 


'0 0 0 1 0 0 0 0 
_0 0 0 0 0 0 0 1 
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9.9999999999999990*99 

9 mmm AAAAAAA AAAAAfi > mm 
1 . B W w WWvWOwv 

9 . 9999999999999990+99 
-6 . 9274981 69338769046 1 


6 . 6966666006006660466 
1 .6006606606666660460 
6 . 0000066066660600460 
-7.01 2276725157268040 1 


■4 . 1 35557638846634040 1 
6 . 0666660060006660466 


6 . 6606666066666660400 
2 . 5035997642427740462 
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From Backward Integration 


AC1 


Column* 1 thru 3 

9 . 8O88899000000800499 

9. 

9. 

-9 . 992892 19691 4998048 1 


-2 . 9727969 1 44484990492 -6 . 929996199999946049 1 



Columns 4 thru 



-1 .2771919999749290491 
AC2 

Columns 1 thru 9 

9 . 9999999999999990499 1 . 999999999989 9 990499 9.9999999999988990498 

9 . 8998999988989990499 9 . 9999998888999990499 1.9999999999999990499 

-2 . 688681 26688371 70499 -9 . 5344768282484960498 -1.2653993999761860491 



Columns 1 thru 3 
4 . 1 458523232998480491 


3.3761 44134559 1 320492 

9.1 


-4.9941 97595588636049 1 
9 . 9998999999909980499 


Columns 4 thru 6 
2.9997948149861200491 
9. 


9 . 9889900998980990499 
-3 . 921 2399843942410499 


8 . 0999998898089080488 
5 . 4869797398459540488 


Columns 7 thru 8 

9 . 8899999990998990499 8 . 8889990899009990499 

4.4523245436926580499 -1 .3961269177378840499 


K = 


[OOOIOOOO ] 1 
00000001 


ORIGINAL PAGE IS 

OF POOR QUALITY 
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APPENDIX D 


The Mini-Mast Example 


A. B and C Matrices 


Columns 1 thru 3 

e . oooooooooooooeoo+oo 

-7 2971 837 S 89606660+62 

e . eooooooooooooooo+oo 
e . oooooooooooooooo+oo 
8 . 8088808006868860+68 
0 . 0888888888888880+86 
8 . 8068088888888880+88 
6 ■ 8888686686688880+88 
0 . 8888008888880980+88 
0 . 0088888888886680+88 
8 . 0080886088880880+86 
0 . 0888860888888880+86 
0 . 8080088888888880+80 

Columns 4 thru 8 

0.0808888888888880+88 
8 . 8868666666666680+88 
8 . 8888886868668880+88 
6 . 8866666668868880 1 88 
-2 . 892873284888888 0 +81 
6 . 8686686886686680+88 
6 . 6866696866668680+88 

8 . 888886 8 666888880 ♦ 88 
6 . 8868 6 66668666680+88 
8 . 8888869666688880+88 
8 . 8800888868888880+88 
8 . 8888888888888860+88 


1 . 8888068888888800+88 
-3 . 8737872288888880+88 
9 . 8008800888088880+88 
8 . 6888886668868680+88 
0 . 8888888888888880+88 
8 . 8888888888898880+88 
0 . 8886088888888800+88 
0 . 8806088888088880+88 
0 . 8888888888869880+88 
9 . 8886088888888680+88 
8 . 8988888888666680+88 
0 . 8688868888666880+88 
0 . 8000800888880060+08 


8 . 88888889 6 8888880+88 
9 . 8888886666686680+88 
0 . 88888868 6 8866680+88 
1 . 8888888 8 66666680+88 
-3 . 4748388 8 8 8 868880-81 
8 . 88888888 8 6888880+88 
8 . 8888868689666680+88 
8 . 8806888888888880+88 
8 . 8888888088688880 ♦ 88 
8 . 8888888888688880+88 
8 . 8888800008888880+88 
8 . 8806668888888880+88 
8 . 6008808808888800+88 


0 . 8088698889060600+80 
•3 . 8338888068888800-8 1 
>3 . 6968686888888000+80 
6 . 0866886880068880+80 
8 . 8686988806880880+88 
9 . 8006996868686880+88 
8 . 6668888860868880+88 
0 . 8088886600880880+80 
0 . 0080868668088680+80 
0 . 8668688800808880+86 
0 . 0800060800886680+68 
0 . 8006066808886080+66 
8 . 8600800088888880+88 


0 . 8688880868866860+88 
6 . 0888888886888800+86 
6 . 8966888888888880+88 
6 . 8688888688888880+88 
6 . 0866688888686000+88 
6 . 8888888808686880+88 
-1 . 477941 1 368888880+83 
6 . 8880866808868880+68 
6 . 8806888886000680+68 
6 . 8880808060686660+88 
0 . 8000886808868880+66 
6 . 0880868888868860+66 
8 . 8886688608888680+60 


ORIGINAL PAGE IS 
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Columns 13 thru 13 



i .2366000000000000-02 
0 . 0000000000000000+00 
-7 . 6433000000000000-03 
- 3 . 0000000000000000+00 


0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 

1 . 6496000000000000-02 

8 . 1 699000000000900-03 

0 . 0000000000000000+00 
0 . 0000000000000000+00 
7 . 6433000000000000-03 


0 . 0000000000000000+00 
0 . 09900900090 9 9 0 0O+09 

. OOvOOVVVVVvVWw f Of 

-1 .5013920046400000+03 
0 . 0000000000000000+00 


0 . 0000000000000000+00 
0 . 0000009900000000+00 
0 . 9000006000000000+00 
0 . 0060000000000000+00 
0 . 0000000000000000+00 
0 . 0000060000000060+00 

6 . 0600000000000000+00 
0 . 0000006000000000+00 
-2 . 8839046040000000+0 1 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
9 . 0000000000000000+00 


0 . 0000000000000000+00 
9 . 0000000000000000+00 

6 . 0060000000000000+00 
0 . 0000000000000000+00 
0 . 0090000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0060000000000000+00 
0 . 0000000000000000+00 
1 .0009000000000000+00 
-7 . 7493600000000000-0 1 
0 . 0000000000000000+00 


GfiSG^ML PAGE IS 

OF POOR QUALITY 
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8 


d . oooooooooeeeoeeo+oo 
i . 9450000000000000-01 
i . oooooooooooooooo+oo 

e . oooooooooooooooo+oo 
a . oooooooooooooooo+oo 
0 . 0000000000000000 + 0 * 

0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 


0 . 0000000000000000+00 

0 . 0000000000000000+00 

>6 . 1 660000000000000-03 
0 . 0000000000000000+00 
-2 . 723300000 0 000000-03 

0 . 0000000000000000+00 
0 . 0000000000000000+00 
-2 . 3483000000000000-03 
0 . 0000000000000000+00 


0 . 0000000000000000+00 

0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
-2 . 723300000000000 0 -03 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
-4. 1 2200000O000000O-03 
0 . 0000000000000000+00 
2 . 3483000000000000-03 
1 . 0000000000000000+00 


C 

Columns 1 thru 3 

-3 . 1 53723865871 1 050-01 
1.2173403844398210-02 
1.3281 6088321 1 2730-01 

Columns 4 thru 6 

-4 . 6378332770877240-02 
6 . 8674267490668580-01 
1 .3100187392326470-01 


0 . 0000000000000000+00 
0 . 0000000000000000+00 


0 . 0000000000000000+00 


0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 


3 . 4485689843979 1 70-0 1 
7 . 9800475026483060-0 1 
-1 . 4333350347133330+00 


Columns 7 thru 9 



0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 


9 . 4790463921 9351 1 D-02 
-4 . 6308 1918744059 20-0 1 
-7.0578931 944483570-0 1 


Columns 10 thru 12 



0 . 0000000060000000+00 


1 . 7383900297065740-02 0 . 0000000000000000+00 
7 . 2230961953354500-01 0.0000000000000000+00 
1 .2087479199906070+00 0.0000000000000000+00 


Columns 13 thru 13 
0 . 0000000000600000+00 
0 . 0000000000000000+06 
0 . 0000000000000000+00 
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1 . 7886376428993840+02 
-1 . 7331274779256350+62 

d AAAA AA AAAAAAAAit«» . AA 

• OvQOvvvvvVVQWW t W 

e . eeeeeeeeeeeeeeeo+ee 


9 aaaaa a**aaa aaaa a . 

. OCvVOVOVOOvVOOVU I 9 V 

-1 .3202992075299570462 
6 . 03971 60363859990482 


-5.71511 5708579 1 300481 


-2.488179791511 2580483 


0 . 0000000000000000408 

0 A AAAAAAAAAA AAAiW . AA 

. vvvoQOUvOvvvvvvl/tVv 

-1.4722712851854020483 
4 . 0503 1 37031 1 27070483 
0 . 0000000000000000408 

0 AAAAAAAAAAAAAAA A . 

. DuvvvovvvQvvvvvvl tfv 


6 . 0000000000000000+00 
e . 0000000000000000+00 

•1 .1676058827447940+02 
1 . 56339431 368456 1 0+92 
6 . 0066666600606000+00 
0 . 0000000600000000+00 


§ . oooooooooooooeeD+oo 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000006600000000+00 
1 .6175727869914420+02 
-7 . 5371 620195443560+02 


0 . 0000000000060000+00 
-1 . 83543455 1 9047 1 70+03 

e AAAAAAAAiuiaaaaarvxaa 
. vOvVvQVVVVOVoo 0 Lm 3 o 


6 . 0600000000000000+00 
0 . 0060006000000000+00 
1.308543103519688 O +03 


0 . 0000000000000000+00 
8. 1040633692306930+02 
-3.899472333264596 O +03 
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APPENDIX E 


The SCOLE Example 

A. B. C. and H Matrices 


A = Blockdiag( A t , A 2 , A 3 , A 4 , A 5 , A 9 , A 7 , A 3 ) 

At 


0 . 0000000000000000+00 1 . 0000000000000000+00 

-3 . 028330844 1 000000-02 -3 . 4804200000000000-04 

A2 


0 . 0000000000000000+00 1 . 0000000000000000+00 
-1 .6061338675600000+01 -8.0153200000000000-03 


A3 

0 . 0000000000000000+00 
-3 . 9323058056100000-01 

A4 - 

0 . 0000000000000000+00 
-1 .2636603040000000+01 

A3 

0 . 0000000000000000+00 
-1 .0187874225000000+00 

A6 

0 . 0000000000000000+00 
-9 . 0485373264400000+01 


1 . 0000000000000000+00 
-1 .2541620000000000-03 


1 . 800660600 86 00000+06 
-7 . 1 096000066660000-03 


1 . 0000000006000000+00 
-2 .0187000000000000-03 


1 . 0000000000000000+00 
-1 . 9024760000000000-02 


A7 


0 . 0000000000000000+00 1 . 0000006000000000+00 
-3.4211311 369000000+02 -3 * 69926000060066^0^2 

A8 


0 . eoeeeeeeeeeeeeeo+eo 

-7 . 3769 1 68644666000+62 


— 8 • 3632466666666660—62 
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8 


0 . 0000000000000000+00 
7 . 3592770000000000—03 
0 . 0000000000000000+00 
4 . 8680630000000000-02 
0 . 0000000000000000+00 
-8 . 9523 490000000000—03 

-2 . 0498210000000000-03 

0 a a aaaaaaaaaaaaarv^aa 
■ OOVvOvvOOvvvOOvi/tVv 

8 . 2949470000000000-03 
8 . 1 949120000000000-03 

0 aaaaaaaaaaaj*aaart_i^aa 
• VvvOv«OVVVVUVVVl/tVv 

-1 .6937500000000000-01 
0 . 0000000000000000+00 
1 .4167740000000000-01 


1 . 8027470000000000-02 
0 . 0000000000000000+00 
6 . 0679 1 40000000000-04 

• OOvOv vvWvOvWOVTW 

-1.24111 70000000000-03 

I . / 0^*e*QVvVVVVVw ia V^ 

-2 . 4884400000000000-02 

0 aaaaaaaaaaa aAaart i aa 

. OOeOvvvvvVvOvvw t W 

3 . 4661870000000000-03 

1.2231 360000000000-05 
0 . 0000000000000000+00 
9 . 5598620000000000-05 


1 . 4557640000000000-02 

. / ivvVvOTvvtnrv 4 

e aaaaaaaaa a aaaaaA » a a 

* vvvvvirvvwVvvvvvvTvv 

-2 . 0055020000000000-02 

0 AAAAAAAAAAAAAAAOxa A 

9 . 3684840000000000-03 
0 . 0000000000000000+00 
-5 . 244 1 270000000000-04 

1 .8227020000000000-03 

3 . 04070 1 0000000000-03 


1.5874120000000000-02 

0 AAAAAAAAAAAAAAA^±AA 
* OvVVVvVvvOVVvVOl/tvo 

2 . 1 288220000000000-03 
-2 . 4864060000000000-03 
2 . 5243030000000000—03 
-2 . 6949000000000000—02 
-2 • 7273 1 20000000000-0 1 

0 AAAAAAAA AAAA AA AftxAA 
• wvvvvvwv OOwwwwOl/tvw 

- 9 . 5346770000000000-04 
e . 0000000000000000+00 

-5 . 96741 90000000000-03 
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Column* 1 thru 3 
1 .2166893000060000-02 
9 . *548750000000000-03 
2 . 1 533400000000000-03 
1.31 33990800000000*00 
-1 .5315921300000000*00 

Column* 4 thru 0 

0 . 0000000000000000*00 
0 . 0000000000000000*00 
0 . 0000000000000000*00 
0 . 0000000000000000*00 
0 . 0000000000000000 l 00 

Column* 7 thru 9 

3 . 2332330000000000-03 
-6 . 5868740000000000-02 
-2 . 3458760000000000-03 
3.11 08665000000000*00 
5 . 7946850000000000-02 


Columns 10 thru 12 



Column* 13 thru 15 
1 . 637451 5900000060-01 
-9 . 9853693000000000-02 
9 . 6569683000000000-04 
-7.3661 080000000000-02 
-1.131 6478000000000-01 

Column* 16 thru 16 

0 . 0000000000000000*00 
0 . 0000000000000000*00 
0 . 0000000000000000*00 
0 . 0000000000000000*00 
0 . 0000000000000000*00 


0 . 0000000000000000*00 
0 . 0000000000000000*00 
0 . 0000000000000000+00 
0 . 0000000000000000*00 
0 . 0000000000000000*00 


-1 .1395971000000000-02 
1 . 1 256123000000000-02 
1 .2452880000000000-03 
1.4647998100000000*00 
1 .5276950600000000*00 


0 . 0000000000000000+00 
0 . 0000000000000000*00 
0 . 0000000000000000*00 
0 . 0000000000000000*00 


-6.4895101 000000000-03 
-1 .8573001800000000-02 
2.761971 8960000000-6 1 
-4.7053876270000000*00 
2 . 87981 54 1 70000000*00 


0 . 0000000000600000*00 
0 . 0000006000006000*00 
0 . 0000000000000000*06 
0 . 0000000000000000*00 
0 . 0000000000000000*00 


-8.062661 0000000000-02 
-2. 1718884000006000-03 
-1 .3220293000000000-03 
1 .7691173000000000-01 
-2 . 807725 1 000000000*00 


0 . 0000000000000000*00 

• VyVvvVQvvvvvVOOUTVO 

e AAAaaaAAaAAAAAAfUAA 


5.91 26730000000000-03 
3 . 1 878480000000000-03 
2 . 06451 00000000000-03 
2 . 6286583000000000-0 1 
-6 . 7687583006000000-0 1 


0 SA AAAAAAAA A AAAA^kA A 
• oQOvVVVvtravvvvV irttio 


-1 .3839730800000000-01 
-2 . 3830230600000000-0 1 
6 . 062791 9600000000-03 
4 . 5587262000000000-0 1 
-2 . 5090946000006000-0 1 
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1 . 1 50 1 562447842700+06 0 . 0000000000000000+00 

-6 . 525646 1978101 000-01 1 . 060665459 1 9 1 0500-0 1 

1 .8962604165894900-01 -9.855691562892960 O -01 

0 . 0000000000000000+00 -4 . 5786 1 5505 1 504200+00 
0 . 0000000000000000+00 0 . 0000000000000000+00 
0 . 0000000000000000+00 0 . 0000000000000000+00 


0 . 0000000000000000+00 0 . 0000000000000000+00 

0 . 0000000000000000+00 0 . 0000000000000000+00 

0 . 0000000000000000+00 0 . 0000000000000000+00 
-2 . 9796842964410100-02 0 . 0000000000000000+00 

-1.9406991584865100-02 9.9579509987599800-01 

-5 . 4220799568759000+02 -8 . 55055529898 1 0400-0 1 


8 . 24585741 27602700-01 0 . 0600000000000000+00 

-4.5482752748441900-01 -1 .5125175055555090-02 

-5 . 048697065421 1 400-01 -5 . 7266798505446600-01 

0 . 0000000000000000+06 -5.8611 528265058600+00 

0 . 0000000000000000+06 0 . 0000000000000000+00 
0 . 0000000000000000+60 0 . 0000000000000000+00 


0 . 0000000000000000+66 0 . 0000000000000000+00 
0 . 0000000000006060+66 0 . 0000000000000000+00 
. CCwvCCCOvwvlIwWTW C « vTOwwwwwWvwwOOwUTC O 

- 1 . 4840748555867890-62 0 . 0006600000000000+00 

-1.9588625951765500-62 1 .0679562194556800+00 

-7.577556654226750 O +62 -1 .5925226815724100+00 


1 .0015660491445500-01 0.0000000000000000-00 

-2.51311 57760654700-61 -1 . 0205484602268000+0 1 

4.9993117914079800-61 -1.227581885589800 O + O 0 

0 . 0000000000000660+66 -9 . 06525581 72454300*0 1 
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Column* 1 thru 3 
-1.4976271681375680460 
7.9461391 858963530-92 

9 . 9999999999999990499 

9 . 9999999999999990499 

9 . 9999999999999990499 


-2. 1 796872333738390491 
-5.621 77491 85876420-92 
9 . 9999999999999090499 

9 . 9999999999999990499 
9 . 9999999969999990499 


-2 .42711 3332379939049 1 
1.8325279589479790-91 
9 . 9999999099969990499 
9 . 9999999990699960499 
9 . 9999999999996990499 
9 . 9909999990990990499 


Column* 4 thru 6 
2 . 37989 1 4973538700491 
-2 . 7849536947822300-91 

• vvVVVVVVVOVVvvWtW 


9 . 


9. 


9 . 9909999999696900490 


Column* 7 thru 9 
9 . 9999999996699600496 
9 . 9999996999909990490 
1 .6351687509288390491 
1 .5183385958183390-91 
9 . 0999999999999990499 


9. 


Column* 19 thru 12 



-2 . 7897962134958390491 
1 .7099144317895590-91 

9 . 9099990099999990499 

Column* 13 thru 15 

9 . 9999099999999900499 



9 . 9699990999999990499 
-2.551211 789955569049 1 
-1.2145724324729390-91 


Column* 18 thru 16 



9 . 9999699999999990499 
-5 . 5829999838985 1 90499 
2.9149238809198490499 


1 .5477894557918990499 
-1 .5996397921335990499 
9 . 9999099099999990499 

9 . 9996069999999990499 
9 . 6999999999900090499 


0 . 9999009999999990499 

-3 . 5673222286758990491 
-7 . 1 699979732075590-92 

9 . 9099999999990990499 


8 . 8425643509959400490 
1 . 2574622959291290490 
9 . 9999999099990090499 
9 . 9999996960999990490 
9 . 9999969990090990499 
9 . 9990999999990990499 


9 ^9609699069000060499 
9 . 9999609966999900499 
9 . 4325895 1 99709690499 
-9 . 5894267531 652130-92 
9 . 9999909999609990499 
9 . 9999990999099990499 


-7 . 83476921 1 7942590-91 
9 . 0259496694545790-91 

9 . 0009009999989990499 


9 . 9699996999990900490 

-2.6522178824975800499 
-1 .9165242937569490490 
9 . 0999908999999900499 
9 . 9988089998089990499 


9 . 0989999999999990499 
8 . 0009888899989990499 
9 . 8888980098009090499 
8 . 9980099890999990499 
-1 .2978396934460690499 
1 . 9690984453692590499 


9 . 9889888800999880498 
9 . 8999999088998000489 
0 . 0999998889889890489 
9 . 9888099909899800488 
-1.798111 978399788049 1 
6 . 62442503 1 8349200-9 1 
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Columns 1 thru 3 
-1 . 6759903997729200+09 
3 . 9499336359 1 89500+00 
2 . 3494737246992960-91 
-1 .6992292782192190+99 
-2 . 35927929 1 7792540-94 
-1 .9766561563788590-91 
9 . 9969999999999990+99 
9 . 9969999999999990+99 
9 . 6999999999999990+99 
9 . 9996999999999690+99 
9 . 9966999999999990+99 
9 . 9999999999999990+99 
9 . 9996999999969960+99 
9 . 9999699996999690+99 
9 . 9999999999999990+99 
9 . 99 9 9999999999990+99 


-3 . 5498593541 238290-91 
1 .7619959417627190+99 
-1 .2581898769193390+99 
9 . 733671 1 41 99391 90-91 
-1.111 2739997759980-92 
-2 . 564598723 1 9 1 2490+99 
9 . 9699999999 9 9999 0 +99 
9 . 9966969699999990+99 
9 . 969999999999999P+99 
9 . 9069996969999960+99 
9 . 9999909909999990+99 
0 . 0990000000999990+99 
0 . 0000060000999990+99 
0 . 0000009000099900+99 
0 . 0000990000990990+99 
0 . 0090000069996990+99 


0 . 0009969900999000+90 
0 . 0000009900000090+90 
0 . 0099999999999990+90 
9 . 9999999969999690+96 
9 . 66 9 9669969996990+99 
0 . 0099999999990990+90 
-8 . 6388844951 344590-9 1 
1 . 41 27449724090890+99 
1 .7899946778373100-91 
9 . 2049708969878200-9 1 
-6. 1486844259957730-94 

-3 . 1 0979971 7393 1 460-92 
9 . 0699969999990990+00 
9 . 0009000006900000+00 
0 . 0006009900000000+00 
0 . 0000606009000000+00 


Column* 4 thru 6 

0 . 0990009999999990+99 

0 . 0990099960999990+09 
0 . 0900099999990990+99 
0 . 0000000099060090+96 
0 . 0909990699909090+99 
-2 . 1 7393351 37523090-91 
8.6293248355124990-91 
6 . 1 603604652630000-91 
-1 .1349853733677390+99 
-2 . 9547827575139930-92 
4 . 8329851 1 62856690+99 
6 . 9999969996966990+99 

0 . 99999699 9 9 9 99990+99 
0 . 9999996099 99 9990+99 


0 . 0000060606999990+09 
6 . 0060000699990090+99 
0 . 0000009099999900+99 
0 . 0009000009999990+99 
0 . 0000000009900000+99 
0 . 0000000900099090+99 
0 . 0000000009099990+99 
0 . 0000000000999090+99 
0 . 0000000099009990+99 
0 . 0000000000999990+99 
0 . 0000000009999900+99 
0 . 0000000009099990+99 
2 . 850631 6972581090+99 
-4 . 4682878837459090+99 
-3 . 0514444952923440-02 
2 . 4633487230067590+99 


0 . 0099900000009000+00 
0 . 0090999090000900+90 
0 . 0990600099000090+00 
0 . 0009000090000000+00 
0 . 0000009000000000+90 
0 . 0000000000009000+00 
0 . 0000000090000000+00 
0 . 0999909009000000+00 
0 . 0999990090000000+00 
0 . 0000090000000000+00 
0 . 0999900090900000+00 
0 . 0099999000060000+00 
2 . 60920 1 2243720800+00 
-5 . 1 2754336731 1 9400+00 
-1 .2345846004895700-01 
-5.51 35694203667400+00 
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AC3 

Column* 1 thru 3 
-3 . 744937382267 1 880—61 
3.2113231823961 490-63 
8 . 8668866868866880+88 
8 . 8686666686668860+66 


Column* 4 thru 4 
8 . 6888686668668880+66 
6 . 8666866888668660+66 
9 . 4631969634629680+66 
-1 . 1816377768229380+66 


ver. 


in 


1 .7568186739657680+66 
•9 . 4539177847572780-81 
6 . 1 2459793772751 80-61 


1.1458938196871360+86 
-7 . 8283818713785860-61 
6 . 8366285269671 1 1 0-63 


4 . 4483212782838770-63 
-1 .1550887332432180+66 
-3 . 4312932006468640-64 
0 . 6000000060080660+66 


e AAAAAAAAAAAAAAArtxAA 
• OvVvVvvVVVv«vvOlm>v 

1 .4323596405757160+66 
-3 . 4346570997900400+00 
4 .6155592370242940-02 


. B WwWwCC vWvW W U 

6 . 3886667433456350-03 
-3 . 56885823563 1 0300-0 1 
-3 . 5765426 1 79868200+00 


8 . 0008800000000000+00 
1 .9991327322235410-04 
-1 . 181902941 9035800+00 
-9.4628287741129600+00 
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Columns 1 thru 3 

-1 .2905106835941300+61 
-4 . 839641 2930919800-61 
0 , 0000000000000000+00 
-2 . 4404434535431300-61 
0 . 0000000000000000+06 
0 . 0000000000000000+00 

Columns 4 thru 6 

-1 .4243172374311900+61 
-1 . 1924772164879000+00 

-4 . 3977667824237600-61 
0 . 0000060000000000+66 
0 . 0000000000600600+00 


-9 . 7902454337776400+00 
-7.12011 34590 1 35900-62 
0 . 0000000000000000+00 
-6 .32811061 09 626090-02 
0 . 0000000000000000+60 
. OOvVOvVvvvvQOQQUtVv 


-2 . 9776073040637000-61 
-4 . 3908376594692400+01 
5.2171 962237435500-62 
0 . 0000000000000000+66 
0 . 0000600000000000+06 


3.3155104248811300+01 
1 . 0037995072231 1 00+00 
0 . 0000000000000000+00 
4.8223413860783100-01 
0 . 0000000000000000+00 
0.0000000660000000+00 


0 . 0000000660000000+00 
2 . 5598 1 75 60055 1200-01 
-2 . 3534689931 498900+0 1 
-2.2754928371278100-01 
0 . 0000000000000000+00 
0 . 0000000000000000+00 


Columns 7 thru 9 

. BvOWllWWWwwt VW 

5 . 5479604279267330-03 
2.01 008093601 1 4200+61 
3 . 2246387813332500-01 

0 . 0000000600000000+66 


0 . 0000000000606660+00 
1 .0031288582698100-61 
1 . 6767879802579700+61 
2 . 0028442485694790-02 

. BBwvBBBBwBvwBWTW 
0 . 0000000000000000+60 


0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000060000000+00 
0 . 0000006000000000+00 
-1 .1588016512750100+00 
-1.1325586849216520-02 


Columns 10 thru 12 

0 . 0000000000000000+00 
0 . 0000600000000000+60 

2 . 3537399696900100+01 
1 .2606717668221900-01 


. DyOVVOUOvVVVwvwTVV 

e aaaaa a a a a a a a a a anjjui 
. OwwwwOwwWWWWTW 

0 AAAAa AAAAAAAAAAfUAJI 

5 . 2024719662420300+00 
-1.3034576831215000+00 


0 . 0000000000000000+00 
0 . 0006000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
4 . 9828555367877 1 00+00 
-2 . 2008434997725000+00 


Columns 1 thru 3 
-5 . 8095502148254700+06 
-3 . 8648984769732300+06 
-1 . 2900521 1 1 7248460+61' 
-1 .2371039936431300+61 
0 . 0000000600060000+06 
6 . 0000666666060060+66 
0 . 0000000000000000+66 
0 . 0000000000600060+00 
0 . 0000000000060600+06 
0 . 0000000000000000+66 
0 . 0000000006000000+66 
0 . 0000000000066000+00 


-7.101 6543544722300+60 
9 . 940574569681 1 400+66 
1.195747926759960O+61 
5.676304233116680O+61 
0 . 0000000000000000+00 
0 . 0000000000000600+00 
0 . 0000000000000000+66 
0 . 0000000000000000+06 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+06 
0 . 0000000000000060+00 


0 . 0000000000000000+00 
0 . 0000000000000000+00 

0 . 0000000000000000+00 
7.0431114229947300-01 
1.4579129485227800+00 
2.70691231 42988500-0 1 
-8 . 48045945903 1 8200-0 1 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 


264 


GFviG'iNAL PAGE IS 

OF POOR QUALITY 



Column* 4 thru 6 

e . 0000000000000000+00 
e . 0000000000000000+00 

0 . 9900000000009000+06 
0 . 0000000000006000+00 
5 . *848206002479000-01 
5 . 8279263344644000-01 
-1 .4227713603981300+00 
6 . 9284042402988900-01 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 


0 . 0000000006600600+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 

0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
-8.7019751 300192600+00 
-3 . 82826383 1 43571 00+00 
-5.7174211 6456601 00-02 
-5.6501444814261870-02 


0 . 0600000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0006000000000000+00 
0 . 0006000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000600000+00 
-8 . 1 730824481 793800+00 
-3.5164001 329745700+00 
3 . 7544642564023000+00 
5 . 33395 1 0232294900+00 


Reduced Order Decentralized Controller fRQDC) 


AC1 


Column* 1 thru 3 
-1.11 199278S5336S2O+00 
-2 . 5760507957037800+00 
0 . 0000000600000000+00 
0 . 0000000000000000+00 


Columns 4 thru 4 



-2 . 7369640862828980+01 


2 . 5760507957037800+06 
■1 . 1 119927855336520+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 


0 . 0000060000000000+00 
0 . 0000000000000000+00 
-5 . 673182641 0306590+00 
0 . 0000000000000000+00 


AC2 

Column* 1 thru 3 

-7 . 3967752995653940-61 
-1 . 1623673719646270+00 
0 . 0000000006060000+00 
0 . 0000000000000000+06 

Column* 4 thru 4 

0 . 0000660000000000+00 

3 . 58698280709365 1 0+00 
-3 . 64551503566901 1 0-01 


1 .1623673719646270+00 
-7 . 3967752993653940-01 
0 . 0000000000000600+00 
0 . 0000000000000000+00 


6 . 0000000000000000+00 
6 . 0000600000000000+00 
-3 . 6455 1 50356690 110-01 
-3 . 56696280709365 1 0+00 
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e . eeeeeeeeeeoeeeoo+ee 

-1 . 15441 54652892920+99 

e . oceeeeeeeeeweeD+ee 

0 . 0000000000000000+00 


1 .0221428762493660+01 
5.7804177351552610-02 

0 A A A A AA A A A A A A AAAfUJMI 
. OVvOvvvQVvvVv WWTW 

A aAAAAAAAAAAAAAAfUM 

« . oywOwOOvvvvvvvwTvv 

0 . 9999999999999990*99 


9 . 00000000000000004-00 
0 . 0000000000000000400 
-4 . 3907753904034050+01 
5 . 0017403490711940-02 
0 . 0000000000000000+00 
0 . 0000000000000000+00 


1 . 5770393437052950+01 
6 . 2279499227674440-02 
0 . 0000000000000090+00 
0 . 0000000000000090+00 


0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
5.2020021 029267750+00 
-1 .3037273069188930+00 


0 . 0000000000000000+00 
0.0000000000000000+00 
-1 .1619098698787430+00 
9 . 4629538746350930+00 


3 . 2506762313081 690+01 
1 . 00591 1 0896554820+00 
0 . 0000000000000000+00 

0 A A A A A AAA A A A A AAAfU.A A 
« OvVOVOW v ww v O u vl/to O 

0 AAAAAAAAAAAAAAAft i AA 


9 . 9999999999990090+90 
e . 0000000000000000+00 

-2 . 3533403533990040+9 1 
-2 . 632993085269S26O-0 1 

e AAAAAAAAAAAAAAAfWK A 
• OO v V vv W V v V v 6 v V W tV o 


0 . 0000000000000000+00 

0 . 0000600000000000+00 

e AAAAAAAAAAOAAAAnxAA 
« QvQvvQvvVvoyQOvUtvO 

-1 . 1 604829S668S230O+00 
-1.1351 70654446 1 360-0 2 


0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
4.9831 493350762560+00 
-2.201 0946075972240+00 
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Column* 1 thru 3 

-4.2341451098444380+00 -6.699670581919209O+0® 0.0000000000000000+00 

-3 . 1 673379724053870+00 8 . 6778378343882970+00 0 . 0000000000000000+00 

-1.2678751450052930+01 1.208112598855627O+01 0.0000000000000000+00 

-1.344235581527970O+01 5.648377413710692O+01 0.0000000000000000+00 

0 . 0000000000000000+00 0 • 0000000000000000+00 7 . 00734 13321 265330-0 1 

0.0000000000000000+00 0.0000000000000000+00 1.4632309995295740+00 

0.0000000000000000+00 0.0000000000000000+00 2.8468593488187480-01 

0.0000000000000000+00 0.0000000000000000+00 -8.5583518956641290-01 

0 . 0000000000000000+00 0 • 0000000000000000+00 0 . 0000000000000000+00 

0 . 0000000000000000+00 0 . 0000000000000000+00 0 . 0000000000000000+00 

0 . 0000000000000000+00 0 ■ 0000000000000000+00 0 . 0000000000000000+00 

0 . 0000000 0 0 0 00000 0 +00 O . 0000000000000000+00 0 . 0000000000000000+00 


Column* 4 thru 6 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
5 . 68621 66810232300-01 
5 . 8632071 384221900-01 
-1 .4550934774426920+00 
6 . 82670277 179541 50-0 1 
0 . 0000000000000000+00 
0 . 0000000000000000+00 

0 . 0000000000000000+00 


0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
- 6 . 7022241 826587070+00 
- 3 . 82739 1 3096442860+00 
- 5 . 71 59994996600650-02 
- 5 . 639468567612581 0-02 


0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
0 . 0000000000000000+00 
-8.171 4227693 1 30040+00 
-3.51 52929 1 67565860+00 
3 . 7348961281 843320+00 
3 . 3336735748484070+00 
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